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Sir: 
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IN THE CLAIMS 
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44. (Amended) A data storage medium containing an image processing program for 
making a computer perform image data processing, said image processing program being a 
program for making a computer perform image processing of an apparatus [defined in any of 
Claims 1 to 43], or a program for implementing, with a computer, the function of at least one 
means which constitutes an apparatus;, defined in any of Claims [1 to 43] 1-12, 17-28, and 34-43 . 



Claim 45, line 1 9, after " 1 7, " delete " 1 8, and 33 " and after " 1 7, " insert -and 1 8-. 
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Claim 46, 



line 18, after "12," delete "16,". 



Claim 47, line 1 9, after "9," delete "14,"; and 

line 20, after "18" delete ", and 33" and after "17," insert -and 18--. 

REMARKS 

The present Preliminary Amendment is submitted to delete the multiple dependency of the 
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fee. 
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DESCRIPTION 

IMAGE CODING APPARATUS, IMAGE DECODING APPARATUS, 
CHARACTER COLLATION APPARATUS, AND DATA STORAGE MEDIUM 

TECHNICAL FIELD 

The present invention relates to an image coding apparatus, 
an image decoding apparatus, and a data storage medium and, more 
particularly, to a coding process for efficiently coding document 
image data, i.e., binary image data obtained by converting an 
document image (an image including characters) into electronic 
form with a scanner or the like, for transmission or storage, and 
a decoding process adapted to the coding process and, furthermore, 
a data storage medium containing a program for making a computer 
perform these processes. 

Further, the invention relates to a character collation 
apparatus and a data storage medium and, more particularly, to a 
collation process for collating a character image (an image 
expressing a character) to be retrieved, with inputted retrieval 
data without decoding coded data corresponding to the character 
image (a character image code), and a data storage medium 
containing a program for making a computer perform the collation 
process . 



BACKGROUND ART 
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There has conventionally been a document filing apparatus 
for converting information of a document image including 
characters and pictures into electronic form to record it as 
document image data. In recent years, with increase in document 
image data to be recorded in such document filing apparatus, much 
effort is required to input or update key words and class codes 
for retrieving a document image when recording it in the filing 
apparatus . 

In order to reduce the effort to input or update the data 
for retrieval when recording the document image, the recent 
document filing apparatus includes a document image storage means 
in which document image data obtained by converting an document 
image into electronic form with a scanner or the like is 
associated with character data obtained by recognizing the 
document image as characters (refer to Japanese Patent Gazette 
No. 25 60 65 6 (Japanese Published Patent Application No. Hei.8- 
87528) ) . 

Figure 39 is a block diagram for explaining an example of a 
conventional document filing apparatus . 

A conventional document filing apparatus 3900 includes an 
image coding means 3902 for coding binary image data (document 
image data) Di obtained by converting a document image into 
electronic form, which is supplied from the outside, by using a 
scheme such as MH (Modified Huffman) or MR (Modified Read) , and 
outputting coded data De corresponding to the document image; and 
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a character recognition means 3901 for subjecting the document 
image data Di to character recognition, and outputting, as 
character data, character codes Deo of plural candidate 
characters for every character included in the document image. 
In the character recognition process, the character recognition 
means 3901 employs, for example, a method of pattern recognition 
by an OCR (Optical Character Reader) . 

The document filing apparatus 3900 further includes a 
document image storage means 3 903 in which coded data De 
corresponding to each document image is associated with character 
codes Deo (i.e., character codes of plural candidate characters 
relating to the document image) . 

Further, the document filing apparatus 3900 includes a data 
reading means 3904 for reading coded data De corresponding to a 
specific document image stored in the document image storage 
means 3 903, on the basis of character codes supplied from the 
outside as retrieval data Da; and an image decoding means 3905 
for decoding the read coded data De to restore document image 
data Di corresponding to the specific document image. The data 
reading means 3904 collates the character codes as the retrieval 
data Da (retrieval character code) with the character codes 
stored in the document image storage means 3903 (stored character 
codes), and outputs coded data De of a document image 
corresponding to the stored character codes which match the 
retrieval character codes. 
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In the document filing apparatus 3900, the character 
recognition means 3901 is constructed so as to output character 
codes Deo of plural candidate characters as character data 
obtained by performing character recognition on each character, 
whereby adverse effect of errors in the character recognition on 
the retrieval is reduced. 

When document image data Di is input to the document filing 
apparatus 3900 so constructed, the image coding means 3902 
encodes the document image data Di to output coded data De . The 
character recognition means 3901 extracts a character image 
included in the document image on the basis of the document image 
data Di, and outputs character codes Deo of plural candidate 
characters corresponding to this character image. 

Then, the coded data De corresponding to one document image 
are associated with the plural character codes Deo to be stored 
in the document image storage means 3903. 

Further, when the retrieval data Da is supplied from the 
outside, the data reading means 3904 reads coded data De 
corresponding to a predetermined document image stored in the 
document image storage means 3900, on the basis of the character 
codes as the retrieval data Da, and the image decoding means 3905 
decodes the coded data De to restore the document image data Di. 

In the conventional document filing apparatus 3900 so 
constructed, however, the coding process on the document image 
data Di by the image coding means 3 902 is performed uniformly 
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regardless of the types of characters included in the document 
image or regardless of the types of components of the document 
image such as characters, diagrams, pictures, etc., and therefore, 
the coding efficiency is degraded in some instances. 

Further, in the conventional document filing apparatus 3900, 
the character recognition means 3901 performs character 
recognition on each character included in the document image, and 
outputs character codes of plural candidate characters for each 
character included in the document image. However, usually the 
plural candidate characters obtained as the result of character 
recognition for one character have a tendency to be similar in 
shape. In other words, when one candidate character (usually, a 
first candidate character) is recognized, other candidate 
characters can be roughly analogized. Therefore, to derive 
plural candidate character codes by performing character 
recognition on each character results in redundant character data 
obtained, whereby the quantity of data is increased. 

The present invention is made to solve the above-described 
problems and it is an object of the present invention to provide 
an image coding apparatus which can realize a coding process for 
efficiently coding data of a document image including characters 
without degrading facility in retrieval of a character image 
included in the document image, an image decoding apparatus which 
can preferably perform a decoding process adapted to the coding 
process, and a data storage medium containing a program for 
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making a computer perform the coding process and the decoding 
process . 

Further, it is another object of the present invention to 
provide a document collation apparatus which can perform a 
collation process of collating a character image code obtained by 
coding image data corresponding to a character image (character 
part of a document image) with input character data without 
decoding the character image code, and a data storage medium 
containing a program for making a computer perform the collation 
process . 

DISCLOSURE OF THE INVENTION 

An image coding apparatus according to the present invention 

(Claim 1) is an apparatus for coding image data corresponding to 
a target image to be coded, on the basis of image data 
corresponding to a predictive image similar to the target image, 
and this apparatus comprises: predictive image generation means 
for generating image data corresponding to partial predictive 
images which are similar to plural partial images constituting 
the target image, on the basis of image feature data indicating 
features of the plural partial images; image composition means 
for compositing the plural partial predictive images on the basis 
of the image data of the plural partial predictive images and 
auxiliary data indicating the positions and sizes of the 
respective partial images in the target image, thereby generating 
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image data of the predictive image; and entropy coding means for 
subjecting the image data of the target image to entropy coding 
utilizing the correlation in pixel values between the target 
image and the predictive image, and outputting entropy codes as 
coded image data of the target image. This image coding 
apparatus outputs the image feature data and the auxiliary data 
as well as the entropy codes. 

In the image coding apparatus according to Claim 1, 
predictive image data for the target image is generated on the 
basis of the image feature data indicating the feature of the 
target image, and the image data of the target image is subjected 
to entropy coding with reference to the predictive image data. 
Therefore, the coding efficiency of the entropy coding for the 
image data of the target image is improved. Further, the 
easiness in retrieving the target image using the image feature 
data is not impaired. 

According to the present invention (Claim 2), the image 
coding apparatus defined in Claim 1 further comprises image 
feature extraction means for generating the image feature data 
indicating the features of the respective partial images 
constituting the target image, and the auxiliary data indicating 
the positions and sizes of the respective partial images in the 
target image, on the basis of the image data of the target image. 

Since the image coding apparatus according to Claim 2 is 
provided with the image feature extraction means for extracting 
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the image feature data from the image data of the target image, 
in addition to the components of the image coding apparatus of 
Claim 1, extraction of the image feature data from the image data 
of the target image is performed automatically, whereby an image 
coding apparatus useful as an image coding means in a facsimile 
or the like is obtained, in addition to the effect of Claim 1 
that the coding efficiency is improved without impairing the 
easiness in retrieving the target image using the image feature 
data. 

According to the present invention (Claim 3), in the image 
coding apparatus defined in Claim 2, the entropy coding means 
comprises: first image blocking means for dividing the image data 
of the predictive image into image data corresponding to plural 
predictive blocks constituting the predictive image and each 
having a predetermined size, and outputting the image data of 
each predictive block; second image blocking means for dividing 
the image data of the target image into image data corresponding 
to plural target blocks constituting the target image and each 
having a predetermined size, and outputting the image data of 
each target block; and block predictive coding means for 
subjecting the image data of each target block to entropy coding 
on the basis of the correlation in pixel values between each 
predictive block and each target block. The block predictive 
coding means performs entropy coding on the image data of the 
target block and outputs the corresponding coded image data and a 
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coding flag when the difference between the target block and the 
predictive block is equal to or larger than a predetermined 
reference value; on the other hand, the block predictive coding 
means does not perform entropy coding on the target block and 
outputs a non-coding flag when the difference between the target 
block and the predictive block is smaller than the reference 
value . 

In the image coding apparatus according to Claim 3, the 
predictive image is divided into plural predictive blocks of a 
predetermined size on the basis of the predictive image data for 
the target image while the target image is divided into plural 
target blocks of a predetermined size, and the image data of each 
target block is subjected to entropy coding with reference to the 
image data of the corresponding predictive block. At this time, 
only the coded data of the target block, whose difference in 
pixel values between itself and the predictive block is larger 
than a predetermined value, is transmitted. Therefore, the 
coding efficiency is greatly improved by neglecting small 
differences in the block by block comparison, without giving, to 
the viewer, the impression that the image quality is degraded. 

According to the present invention (Claim 4), the image 
coding apparatus defined in Claim 2 further comprises image 
filtering means for subjecting the image data of the predictive 
image to filtering so that minute portions of the predictive 
image are omitted, and outputting the filtered data of the 
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predictive image, and the entropy coding means subjects the image 
data of the target image to entropy coding on the basis of the 
filtered data. 

In the image coding apparatus according to Claim 4, the 
predictive image data obtained on the basis of the image data of 
the target image is subjected to filtering, and the image data of 
the target image is subjected to entropy coding with reference to 
the filtered predictive image data. Therefore, the prediction 
error of the predictive image with respect to the target image is 
reduced by the filtering, whereby the coding efficiency of the 
entropy coding for the image data of the target image is further 
improved. 

An image decoding apparatus according to the present 
invention (Claim 5) is an apparatus for decoding coded image data 
obtained by subjecting image data corresponding to a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image. This image decoding apparatus comprises: 
predictive image generation means for generating image data 
corresponding to partial predictive images similar to plural 
partial images constituting the target image, on the basis of 
image feature data indicating features of the plural partial 
images; image composition means for compositing the plural 
partial predictive images on the basis of the image data of the 
plural partial predictive images and auxiliary data indicating 
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the positions and sizes of the partial images in the target image, 
thereby generating image data of the predictive image; and 
entropy decoding means for subjecting the coded image data of the 
target image to entropy decoding utilizing the correlation in 
pixel values between the target image and the predictive image, 
on the basis of the image data of the predictive image, thereby 
generating image data of the target image. 

In the image decoding apparatus of Claim 5, predictive image 
data for the target image is generated on the basis of the image 
feature of the target image, and the coded data of the target 
image is subjected to entropy decoding with reference to the 
predictive image data. Therefore, it is possible to realize a 
decoding process adaptable to the efficient entropy coding 
process for the target image data using the predictive image data. 

An image decoding apparatus according to the present 
invention (Claim 6) is an apparatus for receiving the coded image 
data, the coding flag or non-coding flag, the image feature data, 
and the auxiliary data which are output from the image coding 
apparatus defined in Cl'aim 3, and generating decoded image data 
of the target image. This image decoding apparatus comprises: 
predictive image generation means for generating image data 
corresponding to partial predictive images similar to plural 
partial images constituting the target image, on the basis of 
image feature data indicating the features of the plural partial 
images; image composition means for compositing the plural 
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partial predictive images on the basis of the image data of the 
plural partial predictive images and auxiliary data indicating 
the positions and sizes of the partial images in the target image, 
thereby generating image data of the predictive image; image 
blocking means for dividing the image data of the predictive 
image into image data corresponding to plural predictive blocks 
constituting the predictive image and each having a predetermined 
size, and outputting the image data of each predictive block; 
block predictive decoding means for subjecting the coded image 
data of the target block to entropy decoding utilizing the 
correlation in pixel values between the target block and the 
predictive block, on the basis of the image data of the 
respective predictive blocks, thereby generating image data of 
the target block; and block assembly means for receiving the 
image data of the predictive blocks and the image data of the 
target blocks, and assembling the target image using the target 
blocks and the predictive blocks, on the basis of the coding flag 
and the non-coding flag, thereby restoring the image data of the 
target image . 

In the image decoding apparatus according to Claim 6, a 
predictive image is generated from the image feature extracted 
from the target image, and this predictive image is divided into 
predictive document blocks of a predetermined size to generate 
image data corresponding to the respective predictive image 
blocks. The coded data of plural image blocks of a predetermined 



13 



size, into which the target image is divided, are subjected to 
entropy coding with reference to the image data of the predictive 
image blocks. At this time, the image data of the corresponding 
predictive image data is output with respect to the target image 
block having a small prediction error, which has not been coded 
yet. Therefore, it is possible to realize a decoding process 
adaptable to the efficient coding process for the image data of 
the target image in units of blocks having a predetermined size. 

According to the present invention (Claim 7) , the image 
decoding apparatus defined in Claim 5 further comprises an image 
filtering means for subjecting the image data of the predictive 
image to filtering such that minute portions of the predictive 
image are omitted, and outputting the filtered data of the 
predictive image, and the entropy decoding means subjects the 
coded image data of the target image to entropy decoding on the 
basis of the filtered data. 

In the image decoding apparatus according to Claim 7, image 
data of the predictive image is generated in advance on the basis 
of the image feature of the target image, and the predictive 
image data is subjected to filtering so that the minute parts of 
the predictive image are omitted. The coded data of the target 
image is subjected to entropy decoding with reference to the 
filtered predictive image data. Therefore, it is possible to 
realize a decoding process adaptable to the efficient coding 
process for the target image data using the filtered predictive 
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image data. 

An image coding apparatus according to the present invention 
(Claim 8) is an apparatus for coding image data of a target image 
to be coded, on the basis of image data of a predictive image 
similar to the target image. This image coding apparatus 
comprises: predictive image generation means for generating image 
data of the predictive image similar to the target image, on the 
basis of image feature data indicating the feature of the target 
image; and entropy coding means for subjecting the image data of 
the target image to entropy coding utilizing the correlation in 
pixel values between the target image and the predictive image, 
and outputting entropy codes as coded image data of the target 
image. This image coding apparatus outputs the entropy codes and 
the image feature data corresponding to the target image. 

In the image coding apparatus according to Claim 8, 
predictive image data for the target image to be coded is 
generated on the basis of the image feature data of the target 
image, and the target image data is subjected to entropy coding 
with reference to the predictive image data. Therefore, the 
coding efficiency of the entropy coding process is improved. 

Further, since the image coding apparatus outputs the image 
feature data of the target image as well as the entropy codes 
(coded data) corresponding to the target image data, the coded 
data of the target image can be retrieved using the image feature 
data. 
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According to the present invention (Claim 9) , the image 
coding apparatus defined in Claim 8 further comprises image 
feature extraction means for extracting the image feature from 
the target image on the basis of the image data of the target 
image, and outputting the image feature data to the predictive 
image generation means. 

Since the image coding apparatus according to Claim 9 is 
provided with the image feature extraction means for extracting 
image feature data of the target image from the target image data, 
extraction of the image feature data from the target image data 
is carried out in the image coding apparatus, whereby an image 
coding apparatus suitable as an image coding means in a document 
filing apparatus or a facsimile is obtained, in addition to the' 
effects of Claim 8. 

According to the present invention (Claim 10), in the image 
coding apparatus defined in Claim 9, the image feature extraction 
means comprises: blocking means for dividing the image data of 
the target image into plural blocks constituting the target image 
and each having a predetermined size, thereby generating image 
data corresponding to the respective blocks; and block smoothing 
means for replacing the image data of each block with a pixel 
value of the highest occurrence frequency among the pixel values 
of pixels in the block, and outputting, as image feature data of 
the target image, image data of a reduced image comprising the 
highest-frequency pixel values of the respective blocks. The 
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predictive image generation means generates image data of a 
predictive image in which all of the pixels constituting each 
block have the highest-frequency pixel values corresponding to 
the target block, which is obtained by enlarging the respective 
pixels of the reduced image to the blocks of the predetermined 
size . 

In the image coding apparatus according to Claim 10, the 
image data of the target image is divided into image data 
corresponding to plural blocks each having a predetermined size, 
and the image data of each block is replaced with a pixel value 
of the highest occurrence frequency among the pixel values of 
pixels in the block, and image data of a reduced image comprising 
the most-frequent pixel values of the respective blocks is output 
as image feature data of the target image. Therefore, the image 
feature data indicating the feature of the target image can be 
easily generated. 

According to the present invention (Claim 11), in the image 
coding apparatus defined in Claim 9, the image feature extraction 
means comprises: feature vector extraction means for outputting a 
feature vector indicating the feature of an image similar to the 
target image; and vector quantization means for subjecting the 
feature vector to quantization, thereby outputting, as image 
feature data of the target image, an identifier which is set on a 
region including the feature vector among plural regions 
partitioning a vector space in which plural learning vectors are 
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defined. The predictive image generation means generates image 
data of a predictive image corresponding to the target image, on 
the basis of a learning vector which is closest to a 
representative feature vector included in the region of the 
vector space where the identifier is set. 

The image coding apparatus according to Claim 11 is provided 
with the image feature extraction means for extracting an 
identifier corresponding to an image similar to the target image 
as the image feature of the target image, and the similar image 
as a predictive image for the target image is obtained on the 
basis of the identifier, and the target image data is subjected 
to entropy coding with reference to the similar image. Therefore, 
the coding efficiency of the entropy coding process is improved 
and, further, the coded data of the target image can be retrieved 
using the identifier. 

Further, the feature vector corresponding to each character 
image included in the target image (document image) is quantized, 
and predictive image data for the character image is generated on 
the basis of the representative feature vector. Therefore, only 
one representative feature vector is output as the image feature 
data of each character image in the document image, whereby the 
image feature data of the document image is prevented from being 
redundant and, moreover, adverse effect of errors in character 
recognition (variations in feature extraction) is reduced when 
performing retrieval of the document image using the image 
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feature data. 

According to the present invention (Claim 12) , there is 
provided an image decoding apparatus for decoding coded image 
data which is obtained by subjecting image data of a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image. This image decoding apparatus comprises: 
predictive image generation means for generating image data of a 
predictive image corresponding to the target image, on the basis 
of image feature data indicating the image feature of the target 
image; and entropy decoding means for subjecting the coded image 
data of the target image to entropy decoding, utilizing the 
correlation in pixel values between the target image and the 
predictive image, on the basis of the image data of the 
predictive image, thereby generating image data of the target 
image . 

The image decoding apparatus according to Claim 12 is 
provided with the predictive image generation means for 
generating predictive image data for the target image on the 
basis of the image feature data of the target image, and the 
coded data is subjected to arithmetic decoding with reference to 
the predictive image data. Therefore, it is possible to realize 
an image decoding apparatus which can correctly decode the 
entropy codes obtained by the efficient arithmetic coding process 
utilizing the correlation between the target image and the 
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predictive image . 

According to the present invention (Claim 13), in the image 
coding apparatus defined in any of Claims 1, 2, 8, and 9, the 
image feature data is image data corresponding to a reduced image, 
which is obtained by dividing the image data of the target image 
into image data corresponding to plural blocks constituting the 
target image and each having a predetermined size, and replacing 
the image data corresponding to each block with a pixel value of 
the highest occurrence frequency among the pixel values of pixels 
in the block; and the predictive image generation means generates 
image data of a predictive image in which all of the pixels 
constituting each block have the highest-frequency pixel value of 
the target block, which is obtained by enlarging the respective' 
pixels of the reduced image to the blocks of the predetermined 
size . 

In the image coding apparatus according to Claim 13, since, 
like Claim 10, image data of a reduced image comprising the most- 
frequent pixel values of the respective blocks is output as image 
feature data of the target image, the image feature data 
indicating the feature of the target image can be easily 
generated. 

According to the present invention, in the image decoding 
apparatus defined in Claim 5 or 12, the image feature data is 
image data corresponding to a reduced image which is obtained by 
dividing the image data of the target image into image data 
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corresponding to plural blocks constituting the target image and 
each having a predetermined size, and replacing the image data 
corresponding to each block with a pixel value of the highest 
occurrence frequency among the pixel values of pixels in the 
block; and the predictive image generation means generates image 
data of a predictive image in which all of the pixels 
constituting each block have the highest-frequency pixel value of 
the target block, which is obtained by enlarging the respective 
pixels of the reduced image to the blocks of the predetermined 
size . 

The image decoding apparatus according to Claim 14 receives, 
as the image feature data, image data of a reduced image which is 
obtained by replacing image data of each of plural blocks of a 
predetermined size, into which the target image is divided, with 
a pixel value of the highest occurrence frequency among the pixel 
values of pixels in the block, and the decoding apparatus 
generates image data of a predictive image in which all of the 
pixels constituting each block have the most-frequent pixel value 
corresponding to the target block, which is obtained by enlarging 
the respective pixels in the reduced image to the blocks of the 
predetermined size. Therefore, it is possible to realize an 
image decoding apparatus adaptable to the image coding apparatus 
according to Claim 13 . 

According to the present invention (Claim 15), in the image 
coding apparatus defined in any of Claims 1, 2, 8 and 9, the 
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image feature data is an identifier associated with a vector 
which is selected from plural already-existing vectors predefined 
in a vector space, by using a feature vector indicating the 
feature of an image similar to the target image; and the 
predictive image generation means outputs, as image data of a 
predictive image for the target image, image data specified by 
the selected vector corresponding to the identifier. 

In the image coding apparatus according to Claim 15, the 
identifier corresponding to the image similar to the target image 
is used as the image feature of the target image, and the similar 
image is obtained as a predictive image for the target image on 
the basis of the identifier, and the target image data is 
subjected to entropy coding with reference to the similar image. 
Therefore, the coding efficiency of the entropy coding "process is 
improved and, furthermore, the coded data of the target image can 
be retrieved using the identifier. 

According to the present invention (Claim 16) , in the image 
decoding apparatus defined in Claim 5 or 12, the image feature 
data is an identifier associated with a vector which is selected 
from plural already-existing vectors predefined in a vector space 
by using a feature vector indicating the feature of an image 
similar to the target image; and the predictive image generation 
means outputs, as image data of a predictive image for the target 
image, image data specified by the selected vector corresponding 
to the identifier. 
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In the image decoding apparatus according to Claim 16, the 
identifier corresponding to the image similar to the target image 
is used as image feature data, and the predictive image data for 
the target image is output on the basis of the identifier. 
Therefore, it is possible to realize an image decoding apparatus 
which can correctly decode the entropy codes obtained by the 
efficient entropy coding utilizing the identifier of the similar 
image of the target image and the correlation in pixel values 
between the target image and the predictive image. 

An image coding apparatus according to the present invention 
(Claim 17) is an apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image similar to the target image. This image coding apparatus 
comprises entropy coding means for receiving the image data of 
the predictive image supplied from the outside, subjecting the 
image data of the target image to entropy coding, utilizing the 
correlation in pixel values between the target image and the 
predictive image, on the basis of the image data of the 
predictive image, and output ting entropy codes as coded image 
data of the target image. This image coding apparatus outputs 
the image data of the predictive image as well as the entropy 
codes of the target image. 

The image coding apparatus according to Claim 17 is provided 
with the entropy coding means for subjecting the target image 
data to entropy coding with reference to the predictive image 



23 



data for the target image, and the data of an image similar to 
the target image, which similar image is specified when 
performing coding on the target image data, is input as 
predictive image data for the target image, whereby the coding 
efficiency of the entropy coding process is improved. 

According to the present invention (Claim 18), the image 
coding apparatus defined in Claim 17 further comprises image 
prediction means for outputting the image data of the predictive 
image similar to the target image, to the entropy coding means, 
on the basis of the image data of the target image. 

In the image coding apparatus according to Claim 18, 
predictive image data for the target image is generated from the 
target image data, and the target image data is subjected to 
entropy coding with reference to the predictive image data. 
Therefore, the coding efficiency of the entropy coding process is 
improved and, furthermore, the coded data of the target image can 
be retrieved using the predictive image data. 

According to the present invention (Claim 19), in the image 
coding apparatus defined in Claim 18, the image predictive means 
comprises: feature vector extraction means for outputting a 
feature vector indicating the image feature of the image similar 
to the target image, on the basis of the image data of the target 
image; vector quantization means for subjecting the feature 
vector to quantization, thereby outputting, as image feature data 
of the target image, an identifier which is set on a region 
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including the feature vector among plural regions partitioning a 
vector space in which plural learning vectors are defined; and 
predictive image generation means for generating data of a 
predictive image for the target image, on the basis of a learning 
vector which is closest to a representative feature vector 
included in the region of the vector space where the identifier 
is set. 

The image coding apparatus according to Claim 19 is provided 
with the predictive image generation means for generating 
predictive image data for the target image from the target image 
data, and the target image data is subjected to entropy coding 
with reference to the predictive image data. Therefore, like 
Claim 18, the coding efficiency of the entropy coding process is 
improved and, further, the coded data of the target image can be 
retrieved using the predictive image data. 

An image decoding apparatus according to the present 
invention (Claim 20) is an apparatus for decoding coded image 
data which is obtained by subjecting image data of a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image. This image decoding apparatus comprises 
entropy decoding means for subjecting the coded image data of the 
target image to entropy decoding, utilizing the correlation in 
pixel values between the target image and the predictive image, 
on the basis of image data of the predictive image which is input 
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separately from the coded image data of the target image, thereby 
generating image data of the target image . 

In the image decoding apparatus according to Claim 20, since 
the coded data of the target image is subjected to entropy 
decoding with reference to the predictive image data for the 
target image, it is possible to realize an image decoding 
apparatus which correctly decodes the entropy codes obtained by 
efficient entropy coding utilizing the correlation between the 
target image and the predictive image. 

An image coding apparatus according to the present invention 
(Claim 21) is an apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image for the target image. This image coding apparatus 
comprises: image feature extraction means for extracting the 
image feature from the target image on the basis of the image 
data of the target image, and outputting image feature data of 
the target image; predictive image generation means for 
generating image data of a predictive image similar to the target 
image, on the basis of the image feature data of the target 
image; predictive image storage means for associating image data 
of a target image which has already been coded, with its image 
feature data, and storing them as image data and image feature 
data corresponding to an already-processed image; predictive 
image selection means for comparing the image feature data of the 
target image with the image feature data of the already-processed 
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images which are stored in the predictive image storage means, 
and selecting, as a predictive image, either the similar image or 
a predetermined already-processed image; and entropy coding means 
for subjecting the image data of the target image to entropy 
coding utilizing the correlation in pixel values between the 
target image and the predictive image, thereby outputting entropy 
codes as coded image data of the target image. The predictive 
image selection means outputs a flag indicating that either the 
similar image or the predetermined already-processed image is 
selected as a predictive image, and outputting the image feature 
data of the target image. 

The image coding apparatus according to Claim 21 is provided 
with the predictive image selection means for comparing the image 
feature data of the target image with the image feature data of 
the already-processed images which are stored in the predictive 
image storage means, and selecting either the similar image 
corresponding to the target image or a predetermined already- 
processed image, and the entropy coding means for subjecting the 
image data of the target image to entropy coding outputs a flag 
indicating that either the similar image or the predetermined 
already-processed image is selected, as well as the image feature 
data of the target image. Therefore, the coding efficiency of 
the entropy coding process is improved and, moreover, when the 
character image to be coded is equal to the already-processed 
character image, the process of generating the predictive image 
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data of the target image can be dispensed with, whereby the 
arithmetic load on the coding process using the predictive image 
can be reduced. 

According to the present invention (Claim 22), in the image 
coding apparatus defined in Claim 21, the image feature 
extraction means comprises: feature vector extraction means for 
generating a first feature vector as image feature data 
corresponding to the target image, on the basis of the image data 
of the target image; and character recognition means for 
subjecting the target image to character recognition on the basis 
of the first feature vector to generate a character code 
corresponding to the target image. The predictive image 
generation means generates, as first predictive image data, image 
data of the image similar to the target image, on the basis of 
the character code of the target image; the predictive image 
storage means stores the image data of the target image which has 
already been coded, its character code, and its first feature 
vector, in association with each other; and the predictive image 
selection means reads image data and a feature vector associated 
with a character code which is equal to the character code of the 
target image, as second predictive image data and a second 
feature vector, and outputs one of the first and second 
predictive image data according to the result of comparison 
between the first and second feature vectors. 

In the image coding apparatus according to Claim 22, since 
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the predictive image selection means compares the feature vector 
corresponding to the similar image with the feature vector 
corresponding to the already-processed image and selects either 
the similar image or the already-processed image as a predictive 
image, the selection of the similar image or the already- 
processed image is achieved by the relatively simple process of 
comparing the corresponding feature vectors. 

An image decoding apparatus according to the present 
invention (Claim 23) is an apparatus for decoding coded image 
data which is obtained by subjecting image data of a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image. This image decoding apparatus comprises: 
predictive image generation means for generating image data of an 
image similar to the target image, on the basis of image feature 
data indicating the image feature of the target image; predictive 
image storage means for associating image data of a target image 
which has already been decoded with its image feature data, and 
storing them as image data and image feature data corresponding 
to an already-processed image; predictive image selection means 
for selecting, as a predictive image, either the similar image or 
a predetermined already-processed image, on the basis of flag 
information indicating that either a similar image obtained from 
the image feature of the target image or an already-coded image 
is used as a predictive image for the target image in the coding 
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process; and entropy decoding means for subjecting the coded 
image data of the target image to entropy decoding, on the basis 
of the image data of the predictive image, utilizing the 
correlation in pixel values between the target image and the 
predictive image, thereby generating image data of the target 
image . 

In the image decoding apparatus according to Claim 23, 
either the font image (first predictive image) obtained from the 
character code of the target image or the character image (second 
predictive image) that has already been decoded, which is more 
similar to the target image, is selected as a predictive image, 
and the entropy codes of the target image are decoded with 
reference to the selected predictive image data. Therefore, it 
is possible to realize a decoding process adaptable to the 
entropy coding process which provides high coding efficiency and 
reduces the arithmetic load by omitting the process of generating 
the predictive image data for the target image when the character 
image to be coded is equal to the already-processed character 
image . 

According to the present invention (Claim 24), in the image 
decoding apparatus defined in Claim 23, the predictive image 
generation means generates first predictive image data for the 
target image on the basis of a character code as image feature 
data of the target image; the predictive image storage means 
associates image data of a target image which has already been 
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decoded, with its character code, and stores them as image data 
and a character code of an already-processed image; and the 
predictive image selection means reads image data associated with 
a character code which is equal to the character code of the 
target image, as second predictive image data, from the 
predictive image storage means, and outputs one of the first and 
second predictive image data on the basis of the flag information. 

In the image decoding apparatus according to Claim 24, 
either the font image (first predictive image) obtained from the 
character code of the target image or the character image (second 
predictive image) that has already been decoded, which is more 
similar to the target image, is selected as a predictive image on 
the basis of the flag information, the selection of the 
predictive image at the decoder end is facilitated. 

An image coding apparatus according to the present invention 
(Claim 25) is an apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image for the target image. This image coding apparatus 
comprises : image feature extraction means for extracting the 
image feature of the target image on the basis of the image data 
of the target image, and outputting image feature data of the 
target image; predictive image generation means for generating 
image data of an image similar to the target image, on the basis 
of the image feature data of the target image; predictive image 
storage means for storing image feature data of a target image 



which has already been coded, as image feature data of an 
already-processed image; data output control means for performing 
either a first data output process or a second data output 
process according to the result of comparison between the image 
feature data of the target image and the image feature data of 
the already-processed image stored in the predictive image 
storage means, the first data output process outputting the image 
data of the similar image, the image feature data of the target 
image, and a coding flag indicating that coding should be 
performed, and the second data output process outputting the 
image feature data of the target image and a non-coding flag 
indicating that coding should not be performed; and entropy 
coding means for subjecting the image data of the target image to 
entropy coding utilizing the correlation in pixel values between 
the target image and the similar image, thereby outputting 
entropy codes as coded image data of the target image. The 
entropy coding means performs entropy coding when it receives the 
coding flag, and does not perform entropy coding and outputs no 
entropy code when it receives the non-coding flag. 

In the image coding apparatus according to Claim 25, either 
the first data output process of outputting the image data of the 
similar image, the image feature data of the target image, and 
the coding flag indicating that coding should be performed or the 
second data output process of outputting the image feature data 
of the target image and the non-coding flag indicating that 
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coding should not be performed, is performed according to the 
result of comparison between the image feature data of the target 
image and the image feature data of the already-processed image 
stored in the predictive image storage means. Therefore, the 
coding efficiency of the entropy coding process is improved and, 
moreover, when the character image to be coded is equal to the 
already-processed character image, the process of generating the 
predictive image data of the target image and the process of 
subjecting the target image data to entropy coding are dispensed 
with, whereby the arithmetic load on the coding process using the 
predictive image is reduced. 

According to the present invention (Claim 26), in the image 
coding apparatus defined in Claim 25, the image feature 
extraction means comprises: feature vector extraction means for 
generating a first feature vector as image feature data of the 
target image, on the basis of the image data of the target image; 
and character recognition means for subjecting the target image 
to character recognition on the basis of the first feature vector 
to generate a character code corresponding to the target image. 
The predictive image generation means generates, as predictive 
image data, image data of an image similar to the target image, 
on the basis of the character code of the target image; the 
predictive image storage means stores the character code of a 
target image which has already been coded, in association with 
its first feature vector; and the data output control means reads, 



33 



as a second feature vector of the predictive image, a feature 
vector associated with a character code which is equal to the 
character code of the target image, and performs either a first 
data output process of outputting the image data of the similar 
image, the character code of the target image, and a coding flag 
indicating that coding is to be performed, or a second data 
output process of outputting the character code of the target 
image and a non-coding flag indicating that coding is not to be 
performed. 

In the image coding apparatus according to Claim 2 6, since 
the character code of the character image to be coded is output 
regardless of the first or second data processing, the coded data 
of the target image can be retrieved by using the character code. 

An image decoding apparatus according to the present 
invention (Claim 27) is an apparatus for decoding coded image 
data which is obtained by subjecting image data of a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image. This image decoding apparatus comprises: 
predictive image generation means for generating first predictive 
image data for the target image, on the basis of image feature 
data indicating the image feature of the target image; predictive 
image storage means for associating the image data of a target 
image which has already been decoded, with its image feature data, 
and storing them as image data and image feature data of an 
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already-processed image; data output control means for performing, 
when it receives a coding flag indicating that coding has been 
performed, a first data output process of outputting the first 
predictive image data and the coding flag and, on the other hand, 
performing, when it receives a non-coding flag indicating that 
coding has not been performed, a second data output process of 
reading the image data of the already-processed image as second 
predictive image data from the predictive image storage means, 
and outputting the second predictive image data and the non- 
coding flag; and entropy decoding means for performing, when it 
receives the coding flag, entropy decoding on the coded image 
data of the target image, on the basis of the first predictive 
image data, utilizing the correlation in pixel values between the 
target image and the predictive image and, on the other hand, 
outputting the second predictive image data as decoded data of 
the target image when it receives the non-coding flag. 

In the image decoding apparatus according to Claim 27, when 
receiving the coding flag, the coded image data of the target 
image is subjected to entropy decoding utilizing the correlation 
in pixel values between the target image and the predictive image 
on the basis of the predictive image data for the target image to 
generate decoded data of the target image. On the other hand, 
when receiving the non-coding flag, image data of the already- 
decoded image is output as coded data of the target image. 
Therefore, it is possible to realize an arithmetic decoding 
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process adaptable to the arithmetic coding process which can 
improve the coding efficiency of the arithmetic encoder and 
reduce the arithmetic load by omitting the process of generating 
the predictive image data of the target image and the process of 
subjecting the target image data to arithmetic coding, when the • 
character image to be coded is equal to the already-processed 
character image. 

According to the present invention (Claim 28), in the image 
decoding apparatus of Claim 27, the predictive image generation 
means generates first predictive image data for the target image 
on the basis of the character code as image feature data of the 
target image; the predictive image storage means associates the 
image data of the target image which has already been decoded, 
with its character code, and stores them as image data and a 
character code of an already-processed image; and the data output 
control means reads, as second predictive image data, image data 
associated with a character code which is equal to the character 
code of the target image, and outputs one of the first and second 
■redictive image data on the basis of the flag information. 

In the image decoding apparatus according to Claim 28, since 
either the font image (first predictive image) obtained from the 
character code of the target image or the character image (second 
predictive image) that has already been decoded, which is more 
similar to the target image, is selected as a predictive image on 
the basis of the flag information, the selection of the 
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predictive image at the decoder end is facilitated. 

According to the present invention (Claim 29), in the image 
coding apparatus defined in any of Claims 1, 2, 8, 9, 17, 18, 21, 
and 25, the entropy code is an arithmetic code obtained by 
subjecting the image data of the target image to arithmetic 
coding in which the pixel value probability is changed for each 
of pixels constituting the target image; and the entropy coding 
means changes the pixel value probability, pixel by pixel, on the 
basis of the image data of the predictive image similar to the 
target image, and the image data of the already-coded part of the 
target image . 

In the image coding apparatus according to Claim 29, the 
arithmetic coding for the target image data is performed with ' 
high efficiency on the basis of the image data of the predictive 
image similar to the target image and the image data of the 
already-coded part of the target image. 

According to the present invention (Claim 30), in the image 
decoding apparatus defined in any of Claims 5, 12, 20, 23, and 27, 
the entropy code is an arithmetic code obtained by subjecting the 
image data of the target image to arithmetic coding in which the 
pixel value probability is changed for each of pixels 
constituting the target image; and the entropy decoding means 
subjects the arithmetic code of the target image to arithmetic 
decoding in which the pixel value probability is changed, pixel 
by pixel, on the basis of the image data of the predictive image 
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similar to the target image, and the image data of the already- 
decoded part of the target image, thereby reproduces the image 
data of the target image. 

In the image decoding apparatus according to Claim 30, the 
arithmetic decoding for the coded data of the target image can be 
performed with high efficiency on the basis of the image data of 
the predictive image similar to the target image and the image 
data of the already-coded part of the target image. 

According to the present invention (Claim 31), in the image 
coding apparatus defined in any of Claims 1, 2, 8, 9, 17, 18, 21, 
and 25, the entropy code is a Huffman code obtained by subjecting 
the image data of the target image to a coding process in which a 
Huffman coding table is changed for each of pixels constituting' 
the target image; and the entropy coding means changes the 
Huffman coding table, pixel by pixel, on the basis of the image 
data of the predictive image similar to the target image, and the 
image data of the already-coded part of the target image. 

In the image coding apparatus according to Claim 31, the 
Huffman coding for the target image data is performed with high 
efficiency on the basis of the image data of the predictive image 
similar to the target image and the image data of the already- 
coded part of the target image. 

According to the present invention (Claim 32), in the image 
decoding apparatus defined in any of Claims 5, 12, 20, 23, and 27, 
the entropy code is a Huffman code obtained by subjecting the 



38 



image data of the target image to a coding process in which a 
Huffman coding table is charged for each of pixels constituting 
the target image; and the entropy decoding means subjects the 
coded image data of the target image to a decoding process in 
which the Huffman coding table is changed pixel by pixel, on the 
basis of the image data of the predictive image similar to the 
target image, and the image data corresponding to the already- 
decoded part of the target image, thereby reproduces the image 
data of the target image . 

In the image decoding apparatus according to Claim 32, the 
Huffman decoding for the coded data of the target image is 
performed with high efficiency on the basis of the image data of 
the predictive image similar to the target image and the image 
data of the already-coded part of the target image. 

According to the present invention (Claim 33), in the image 
coding apparatus defined in any of Claims 1, 2, 8, 9, 17, 18, 21 
and 25 further comprises attribute information addition means for 
receiving attribute information relating to the target image, and 
outputting the coded image data of the target image to which the 
attribute information is added. 

In the image coding apparatus according to Claim 33, since 
the attribute information relating to the target image is added 
to the coded image data of the target image when outputting the 
coded image data, the attribute of, for example, a character 
image, can be known without decoding character image codes as the 
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coded image data. 

An image coding apparatus according to the present invention 

(Claim 34) is an apparatus for coding image data of a target 
image to be coded which includes a character image, and this 
image coding apparatus comprises: character image coding means 
for receiving the image data of the target image, and coding the 
image data of the character image included in the target image to 
output character image codes as a part of coded data of the 
target image; character image deletion means for replacing the 
pixel values of pixels constituting a part of the target image 
where the character image is placed, with the pixel values of 
pixels positioned in the vicinity of the character image, thereby 
generating image data of a non-character image where the 
character image of the target image is deleted; and non-character 
image coding means for coding the image data of the non-character 
image to output non-character image codes as a part of the coded 
data of the target image. The character image coding means 
comprises: a predictive image generator for generating image data 
of a predictive image similar to the character image on the basis 
of image feature data indicating the feature of the character 
image; and an entropy encoder for subjecting the image data of 
the target image by utilizing the correlation in pixel values 
between the character image and the predictive image, and 
outputting entropy codes as character image codes of the 
character image. 
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In the image coding apparatus according to Claim 34, since 
the document image data is separated into the character image 
data and the non-character image data when it is coded, the 
character image and the non-character image can be coded by 
highly-efficient coding methods suited to the respective images. 
Further, the coding efficiency for the character image data is 
improved utilizing the correlation between the character image 
and the predictive image. Furthermore, document retrieval can be 
performed utilizing the coded data of the character image 
(character image codes) . 

An image decoding apparatus according to the present 
invention (Claim 35) is an apparatus for receiving the character 
image codes and the non-character image codes outputted from the 
image coding apparatus defined in Claim 34, and reproducing the 
image data of the target image including the character image. 
This image decoding apparatus comprises: non-character image 
decoding means for decoding the non-character image codes to 
output the image data of the non-character image; character image 
decoding means for decoding the character image codes to output 
the image data of the character image; and image reconstruction 
means for compositing the character image and the non-character 
image on the basis of the image data of the character image and 
the image data of the non-character image, and outputting the 
image data of the target image including the character image. 

In the image decoding apparatus according to Claim 35, the 



40/1 



coded data of the character image in the document image and the 
coded data of the non-character image obtained by deleting the 
character image from the document image are received separately 
as the coded data of the document image, and the respective coded 
data are separately decoded to generate document image data and 
non-document image data, and the document image is reconstructed 
on the basis of these data to generate document image data. 
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Therefore, it is possible to realize an image decoding apparatus 
which can correctly decode the coded data obtained by the 
efficient coding methods suited to the character image and the 
non-character image, respectively. 

Further, the document image can be retrieved utilizing the 
coded data of the character image (character image codes) . 

A character collation apparatus according to the present 
invention (36) is an apparatus for collating retrieval data 
indicating a retrieval condition for retrieving a character image, 
with character image codes obtained by coding image data of a 
character image, wherein attribute information relating to a 
character image corresponding to the character image codes is 
added to the character image codes. This character collation 
apparatus is provided with character attribute collation means 
for collating the retrieval data with the character image codes, 
according to whether the attribute information added to the 
character image codes satisfies the retrieval condition indicated 
by the retrieval data. 

Since the character collation apparatus according to Claim 
3 6 is provided with the character collation means for collating 
the attribute information added to the character image codes with 
the retrieval condition to decide whether the attribute 
information satisfies the retrieval condition or not, only a 
large character included in the title line of the document image 
or a character line such as an up-to-down line can be extracted 
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even in the state where the character image data is coded. 

A character collation apparatus according to the present 
invention (Claim 37) is an apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which image feature data indicating the image 
feature of the character image is added, which character image 
codes are obtained by coding image data of the character image. 
This character collation apparatus comprises: image feature 
extraction means for extracting the image feature of the 
character image specified by the character code, and output ting 
it as image feature data; and collation decision means for 
collating the image feature data added to the character image 
codes, with the image feature data obtained from the character 
code, and deciding whether the character image codes match the 
character code. 

Since the character collation apparatus according to Claim 
37 is provided with the image feature extraction means for 
extracting the image feature of a character image specified by a 
character code supplied from the outside is extracted on the 
basis of the character code to output image character data Vc, 
the image feature data included in the character image codes is 
compared with the image feature data of the character image 
corresponding to the character code. Accordingly, when the 
character image specified by the character code is equal to the 
character image corresponding to the character image codes, the 
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character image corresponding to the character image codes is 
known without decoding the character image codes, and this 
enables shape comparison between the character image 
corresponding to the character image codes D2 0 and another 
character image . 

According to the present invention (Claim 38), in the 
character collation apparatus defined in Claim 37, the image 
feature data added to the character image codes is a feature 
vector indicating the image feature of the character image 
corresponding to the character image codes. The image feature 
extraction means comprises character image generation means for 
generating image data of a character image specified by the 
character code, on the basis of the character code; and feature 
vector extraction means for extracting the image feature of the 
character image on the basis of the image data of the character 
image, thereby outputting a feature vector indicating the image 
feature. The collation decision means includes distance 
calculation means for calculating a distance between the feature 
vector added to the character image codes and the feature vector 
obtained from the character code, and decides whether the 
character image codes match the character code or not, according 
to whether the distance is larger than a predetermined threshold 
or not. 

In the character collation apparatus according to Claim 38, 
since whether the character image codes match the character code 
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is decided according to whether the distance between the feature 
vector added to the character image codes and the feature vector 
obtained from the character code is larger than a predetermined 
threshold or not, the collation between the character image codes 
and the character code is facilitated. 

A character collation apparatus according to the present 
invention (Claim 39) is an apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which image data of a predictive character image 
similar to the character image is added, which character image 
codes are obtained by coding image data of the character image. 
This character collation apparatus comprises: first image feature 
extraction means for receiving the character image codes, and 
extracting the image feature from the predictive character image 
on the basis of the image data of the predictive character image 
added to the character image codes, thereby outputting first 
image feature data; second image feature extraction means for 
receiving the character code, and extracting the image feature of 
the character image specified by the character code, thereby 
outputting second image feature data; and collation decision 
means for collating the first image feature data with the second 
image feature data, and deciding whether the character image 
codes match the character code or not. 

The character collation apparatus according to Claim 39 is 
provided with the first image feature extraction means for 
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outputting the first image feature data of the predictive 
character image on the basis of the predictive character image 
data added to the character image codes, and the second image 
feature extraction means for extracting the image feature of the 
character image specified by the character code supplied from the 
outside and outputting the second image feature data. Therefore, 
the image feature data of the character image corresponding to 
the character code is compared with the image feature data of the 
predictive character image included in the character image codes. 
Accordingly, when it is decided that the character image 
specified by the character code matches the predictive character 
image corresponding to the character image codes, the character 
image corresponding to the character image codes can be known 
without decoding the character image codes, and this enables 
shape comparison between the character image corresponding to the 
character image codes and another character image . 

According to the present invention (Claim 40), in the 
character collation apparatus defined in Claim 39, the first 
image feature extraction means outputs a first feature vector as 
the first image feature data. The second image feature 
extraction means comprises character image generation means for 
generating image data of a character image specified by the 
character code, on the basis of the character code; and feature 
vector extraction means for extracting the image feature of the 
character image on the basis of the image data of the character 
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image, thereby outputting a second feature vector indicating the 
image feature. The collation decision means includes distance 
calculation means for calculating the distance between the first 
feature vector and the second feature vector, and decides whether 
the character image codes match the character code or not, 
according to whether the distance is larger than a predetermined 
threshold or not. 

In the character collation apparatus according to Claim 40, 
since whether the character image codes match the character code 
or not is decided according to whether the distance between the 
feature vector added to the character image codes and the feature 
vector obtained from the character code is larger than a 
predetermined threshold or not, the collation between the 
character image codes and the character code is facilitated. 

A character collation apparatus according to the present 
invention (Claim 41) is an apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which an identifier indicating a predictive 
character image similar to the character image is added, which 
character image codes are obtained by coding image data of the 
character image. This character collation apparatus comprises: a 
table storage unit storing a character-to-character distance 
table in which the identifier of the predictive character image 
and the character code are associated with distance information 
which is calculated using the identifier and the character code 
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as variables; distance calculation means for receiving the 
character image codes and the character code, and obtaining 
distance information having, as variables, the predictive 
character image identifier added to the character image code, and 
the character code, with reference to the character-to-character 
distance table; and collation decision means for deciding whether 
the character image codes match the character code or not, on the 
basis of the distance information. 

The character collation apparatus according to Claim 41 is 
provided with the table storage unit storing the character-to- 
character distance table in which the identifier of the 
predictive character image added to the character image codes and 
the character code are associated with distance information which 
is defined using the identifier and the character code as 
variables, and the predictive character image identifier 
identifies the predictive character image similar to the 
character image corresponding to the character image codes, and 
the distance information is a Euclidean distance between the 
feature vector obtained from the character code and the 
representative feature vector obtained from the predictive 
character image identifier. Therefore, the feature vector 
corresponding to the character code is compared with the feature 
vector corresponding to the predictive character image identifier 
included in the character image codes. Accordingly, when it is 
decided that the character image specified by the character code 
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matches the predictive character image corresponding to the 
character image codes, the character image corresponding to the 
character image codes can be known without decoding the character 
image codes, and this enables shape comparison between the 
character image corresponding to the character image codes and 
another character image . 

A character collation apparatus according to the present 
invention (Claim 42) is an apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which an identifier indicating a predictive 
character image similar to the character image is added, which 
character image codes are obtained by coding image data of the 
character image. This character collation apparatus comprises:' 
first image feature extraction means for receiving the character 
image codes, and extracting the image feature from the predictive 
character image on the basis of the identifier indicating the 
predictive character image and added to the character image codes, 
thereby outputting first image feature data; a second image 
feature extraction mans for receiving the character code, and 
extracting the image feature of a character image specified by 
the character code to output second image feature data; and 
collation decision means for collating the first image feature 
data with the second image feature data to decide whether the 
character image code matches the character code or not. 

The character collation apparatus according to Claim 42 is 
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provided with the first image feature extraction means for 
receiving the character image codes and outputting the first 
image feature data of the predictive character image on the basis 
of the predictive character image identifier added to the 
character image codes, and the second image feature extraction 
means for extracting the image feature of the character image 
specified by the character code supplied from the outside and 
outputting the second image feature data. Therefore, the image 
feature data of the character image corresponding to the 
character code is compared with the image feature data 
corresponding to the predictive character image identifier 
included in the character image codes. Accordingly, when it is 
decided that the character image specified by the character code 
matches the predictive character image corresponding to the 
character image codes, the character image corresponding to the 
character image codes can be known according to the inputted 
character code without decoding the character image codes, and 
this enables shape comparison between the character image 
corresponding to the character image codes and another character 
image . 

According to the present invention (Claim 43), in the 
character collation means defined in Claim 42, the first image 
feature extraction means outputs a first feature vector as the 
first image feature data. The second image feature extraction 
means comprises character image generation means for generating 
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image data of a character image specified by the character code, 
on the basis of the character code; and feature vector extraction 
means for extracting the image feature of the character image on 
the basis of the image data of the character image to output a 
second feature vector indicating the image feature. The 
collation decision means includes distance calculation means for 
calculating the distance between the first feature vector and the 
second feature vector, and decides whether the character image 
codes match the character code or not, according to whether the 
distance is larger than a predetermined threshold or not. 

In the character collation apparatus according to Claim 43, 
since whether the character image codes match the character code 
or not is decided according to whether the distance between the' 
feature vector added to the character image codes and the feature 
vector obtained from the character code is larger than a 
predetermined threshold or not, the collation between the 
character image codes and the character code is facilitated. 

A data storage medium according to the present invention 
(Claim 44) is a storage medium containing an image processing 
program for making a computer perform image data processing, and 
the image processing program is a program for making a computer 
perform image processing of an apparatus defined in any of Claims 
1 to 43, or a program for implementing, with a computer, the 
function of at least one means which constitutes an apparatus 
defined in any of Claims 1 to 43. 
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The data storage medium so constructed can implement an 
apparatus defined in any of Claims 1 to 43 with software by 
loading the program into a computer. 

A facsimile according to the present invention (Claim 45) 
comprises: a scanner for converting a target image to be 
transmitted into electronic data, and outputting the target image 
data; an image coding unit for coding the target image data to 
output image feature data indicating the feature of the target 
image as well as the coded data; a transmitter-receiver for 
adding the image feature data of the target image to the coded 
data of the target image, and transmitting/receiving composite 
data including the coded data and the image feature data through 
a communication line; an image decoding unit for receiving the 
coded data and the image feature data included in the composite 
data received by the transmitter-receiver, and decoding the coded 
data on the basis of the image feature data to output target 
image data; and an image output unit for displaying or printing 
out the target image on the basis of the target image data. The 
image coding unit is identical in structure to an image coding 
apparatus as defined in any of Claims 2, 8, 9, 14, 17, 18, and 33. 

In the facsimile according to Claim 45, the image coding 
unit for coding the target image data performs the same coding 
process as described for an image coding apparatus defined in any 
of Claims 2, 8, 9, 14, 17, 18, and 33, whereby the coding 
efficiency of the coding process for the target image data is 
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improved. 

A facsimile according to the present invention (Claim 46) 
comprises: a scanner for converting a target image to be 
transmitted into electronic data, and outputting the target image 
data; an image coding unit for coding the target image data to 
output image feature data indicating the feature of the target 
image as well as the coded data; a transmitter-receiver for 
adding the image feature data relating to the coded data to the 
coded data, and transmitting and receiving composite data 
including the coded data and the image feature data through a 
communication line; an image decoding unit for receiving the 
coded data and the image feature data included in the composite 
data received by the transmitter-receiver, and decoding the coded 
data on the basis of the image feature data to output target 
image data; and an image output unit for displaying or printing 
out the target image on the basis of the target image data. The 
image decoding unit is identical in structure to an image 
decoding apparatus as defined in any of Claims 5, 12, 16, and 20. 

In the facsimile according to Claim 46, the image decoding 
unit for decoding the coded data of the target image performs the 
same decoding process as described for an image decoding 
apparatus defined in any of Claims 5, 12, 16, and 20, whereby a 
decoding process adaptable to the efficient coding process for 
the target image data is realized. 

A filing apparatus according to the present invention (Claim 
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47) comprises: a scanner for converting a target image to be 
filed into electronic data, and outputting the target image data; 
an image coding unit for coding the target image data, and 
outputting image feature data indicating the feature of the 
target image as well as the coded data of the target image; an 
image storage means for storing the coded data in association 
with the corresponding image feature data; a data reading means 
for reading coded data of a predetermined image and the 
corresponding image feature data from the image storage means, on 
the basis of a character code supplied from the outside as 
retrieval data; an image decoding means for decoding the read 
coded data by using the image feature data to restore the image 
data of the predetermined image; and an image output unit for 
displaying or printing out the predetermined image, on the basis 
of the image data. The image coding unit is identical in 
structure to an image coding apparatus as defined in any of 
Claims 2, 8, 9, 14, 17, 18, and 33. 

In the filing apparatus according to Claim 47, the image 
coding unit for coding the target image data performs the same 
coding process as described for an image coding apparatus defined 
in any of Claims 2, 8, 9, 14, 17, 18, and 33, whereby the coding 
efficiency of the coding process for the target image data is 
improved. 

According to the present invention (Claim 48), there is 
provided a filing apparatus comprising: a scanner for converting 
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a target image to be filed into electronic data, and outputting 
the target image data; an image coding unit for coding the target 
image data, and outputting image feature data indicating the 
feature of the target image as well as the coded data of the 
target image; an image storage means for storing the coded data 
in association with the corresponding image feature data; a data 
reading means for reading coded data of a predetermined image and 
the corresponding image feature data from the image storage means, 
on the basis of a character code supplied from the outside as 
retrieval data; an image decoding means for decoding the read 
coded data by using the image feature data to restore the image 
data of the predetermined image; and an image output unit for 
displaying or printing out the predetermined image, on the basis 
of the image data. The image decoding means is identical in 
structure to an image decoding apparatus as defined in any of 
Claims 5, 12, 16, and 20. 

In the filing apparatus according to Claim 48, the image 
decoding unit for decoding the coded data of the target image 
performs the same decoding process as described for an image 
decoding apparatus defined in any of Claims 5, 12, 16, and 20, 
whereby a decoding process adaptable to the efficient coding 
process for the target image data is realized. 

A filing apparatus according to the present invention (Claim 
49) comprises: a scanner for converting a target image to be 
filed into electronic data, and outputting the target image data; 
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an image coding unit for coding the target image data, and 
outputting image feature data indicating the feature of the 
target image as well as the coded data of the target image; a 
document image storage means for storing the coded data in 
association with the corresponding image feature data; a data 
reading means for reading coded data of a predetermined image and 
the corresponding image feature data from the image storage means, 
on the basis of a character code supplied from the outside as 
retrieval data; an image decoding means for decoding the read 
coded data by using the image feature data to restore the image 
data of the predetermined image; and an image output unit for 
displaying or printing out the predetermined image, on the basis 
of the image data. The data reading means includes a character 
collation apparatus as defined in any of Claims 36 to 43. 

In the filing apparatus according to Claim 49, the data 
reading means, which reads the coded data corresponding to a 
predetermined image stored in the image storage means as well as 
the image feature data corresponding to this image on the basis 
of the character code inputted as retrieval data from the outside, 
includes a character collation apparatus defined in any of Claims 
36 to 43. Therefore, when it is decided that the character image 
specified by the character code matches the additional 
information corresponding to the character image codes, the 
character image corresponding to the character image codes can be 
known by the inputted character code without decoding the 



character image codes, and this enables shape comparison between 
the character image corresponding to the character image codes 
and another character image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram for explaining an image coding 
apparatus according to a first embodiment of the present 
invention. 

Figure 2 is a block diagram for explaining an image coding 
apparatus according to a second embodiment of the present 
invention. 

Figure 3 is a block diagram for explaining an image decoding 
apparatus according to a third embodiment of the present 
invention. 

Figure 4 is a block diagram for explaining an image coding 
apparatus according to a fourth embodiment of the present 
invention . 

Figure 5 is a block diagram for explaining an image decoding 
apparatus according to a fifth embodiment of the present 
invention. 

Figure 6 is a block diagram for explaining an image coding 
apparatus according to a sixth embodiment of the present 
invention . 

Figure 7 is a block diagram for explaining an image decoding 
apparatus according to a seventh embodiment of the present 
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invention. 

Figure 8 is a block diagram for explaining an image coding 
apparatus according to an eighth embodiment of the present 
invention. 

Figure 9 is a block diagram for explaining an image coding 
apparatus according to a ninth embodiment of the present 
invention . 

Figure 10 is a block diagram for explaining an image 
decoding apparatus according to a tenth embodiment of the present 
invention. 

Figure 11 is a block diagram for explaining an image coding 
apparatus according to an eleventh embodiment of the present 
invention. 

Figure 12 is a block diagram for explaining an image 
decoding apparatus according to a twelfth embodiment of the 
present invention. 

Figure 13 is a block diagram for explaining an image coding 
apparatus according to a thirteenth embodiment of the present 
invention . 

Figure 14 is a block diagram for explaining an image coding 
apparatus according to a fourteenth embodiment of the present 
invention. 

Figure 15 is a block diagram for explaining an image 
decoding apparatus according to a fifteenth embodiment of the 
present invention. 
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Figure 16 is a block diagram for explaining an image coding 
apparatus according to a sixteenth embodiment of the present 
invention . 

Figure 17 is a block diagram for explaining an image coding 
apparatus according to a seventeenth embodiment of the present 
invention . 

Figure 18 is a block diagram for explaining an image 
decoding apparatus according to an eighteenth embodiment of the 
present invention. 

Figure 19 is a block diagram for explaining a character 
collation apparatus according to a nineteenth embodiment of the 
present invention. 

Figure 20 is a block diagram for explaining a character 
collation apparatus according to a twentieth embodiment of the 
present invention. 

Figure 21 is a block diagram for explaining a character 
collation apparatus according to a twenty-first embodiment of the 
present invention. 

Figure 22 is a block diagram for explaining a character 
collation apparatus according to a twenty-second embodiment of 
the present invention. 

Figure 23 is a block diagram for explaining a character 
collation apparatus according to a twenty-third embodiment of the 
present invention. 

Figure 24(a) is a diagram illustrating XY coordinates 
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corresponding to a character image according to the first 
embodiment, and figure 24 (b) is a diagram illustrating the 
structure of character data corresponding to a character sequence 
included in the document image. 

Figure 25(a) is a diagram illustrating a probability model 
used for arithmetic coding by the image coding apparatus 
according to the first embodiment, figure 25(b) is a schematic 
diagram for explaining arithmetic coding using the probability 
model, and figure 25(c) is a diagram illustrating a binary 
decimal obtained by the arithmetic coding. 

Figure 26 is a diagram for explaining the flow of the 
arithmetic coding by the image coding apparatus according to the 
first embodiment. 

Figure 27 is a diagram for explaining the correspondence 
between a predictive document image and a- document image 
according to the first embodiment. 

Figure 28 is a diagram for explaining the flow of the 
process performed by a block predictive coding means according to 
the fourth embodiment . 

Figure 2 9 is a schematic diagram for explaining data coded 
by the block predictive coding means according to the fourth 
embodiment . 

Figure 30 is a diagram for explaining the flow of the 
process performed by a block predictive decoding means according 
to the fifth embodiment. 
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Figure 31 is a diagram, for explaining the operation of a 
morphological filter according to the sixth embodiment. 

Figure 32 is a diagram for explaining a method for 
extracting mesh feature according to the eighth embodiment. 

Figure 33 is a diagram for explaining a method for 
generating a predictive image from the mesh feature according to 
the eighth embodiment . 

Figure 34 is a diagram for explaining attribute information 
according to the sixteenth embodiment. 

Figure 35 (a) is a schematic diagram illustrating an example 
of attribute information according to the sixteenth embodiment, 
and figure 35(b) is a schematic diagram illustrating an example 
of retrieval condition according to the nineteenth embodiment. 

Figure 36 is a diagram for explaining an example of a 
process for coding a document image by the image coding apparatus 
according to the seventeenth embodiment. 

Figure 37 is a diagram for explaining a character-to- 
character distance table according to a twenty-second embodiment. 

Figure 38 is a block diagram illustrating another structure 
of an image feature extraction means according to the second, 
fourth, and sixth embodiments. 

Figure 39 is a block diagram for explaining the conventional 
document filing apparatus . 

Figures 40(a), 40(b), and 40(c) are diagrams for explaining 
a data storage medium which stores a program for performing, 
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using software, a coding process, a decoding process, or a 
collation process according to any of the embodiments of the 
present invention. 

Figure 41(a) is a block diagram for explaining a facsimile 
including the image coding apparatus of the second embodiment and 
the image decoding apparatus of the third embodiment, and figure 
41(b) is a block diagram for explaining a document filing 
apparatus including the image coding apparatus and the image 
decoding apparatus . 

Figure 42 is a block diagram for explaining an image coding 
apparatus according to a twenty-fourth embodiment of the 
invention . 

Figure 43 is a block diagram for explaining an image 
decoding apparatus according to a twenty-fifth embodiment of the 
invention . 

Figure 44 is a diagram illustrating the flow of operation of 
a predictive image selection means as a component of the image 
coding apparatus according to the twenty- fourth embodiment. 

Figure 45 is a diagram illustrating the flow of operation of 
a predictive image selection means as a component of the image 
decoding apparatus according to the twenty-fifth embodiment. 

Figure 4 6 is a block diagram for explaining an image coding 
apparatus according to a twenty-sixth embodiment of the invention. 

Figure 47 is a block diagram for explaining an image 
decoding apparatus according to a twenty-seventh embodiment of 
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the invention. 

Figure 48 is a diagram illustrating the flow of operation of 
a predictive image selection means as a component of the image 
coding apparatus according to the twenty-sixth embodiment. 

Figure 49 is a diagram illustrating the flow of operation of 
a predictive image selection means as a component of the image 
decoding apparatus according to the twenty- seventh embodiment. 

BEST MODE TO EXECUTE THE INVENTION 

Hereinafter, embodiments of the present invention will be 
described with reference to the drawings. 
(Embodiment 1) 

Figure 1 is a block diagram illustrating the structure of 'an 
image coding apparatus according to a first embodiment of the 
present invention. This first embodiment corresponds to the 
invention of Claim 1. 

An image coding apparatus 100 of this first embodiment 
receives document image data Di which is obtained by converting 
an document image 101 including Gothic type characters (image 
including characters) into electronic form by a scanner or the 
like, and encodes the document image data Di . For example, the 
image coding apparatus 100 is used as the image coding means 3902 
in the document filing apparatus 3900 shown in figure 39. A 
document image includes, as its partial image, a character image 
comprising a character or a symbol, or a part of the character or 
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symbol. Each character image is associated with character data. 
The reason why a document image includes a character image 
comprising a part of a character or symbol is because each part 
of one character or symbol is sometimes recognized as one 
character or symbol. For example, as for a Chinese character 

its left-hand radical and right-hand radical might be 
recognized as a Katakana character n -i " and a Chinese character 
", respectively. 

The image coding apparatus 100 of this first embodiment 
includes a predictive image generation means 103 which receives 
character data Dc including auxiliary information indicating 
character codes corresponding to the respective characters in the 
document image 101, the sizes of the respective characters, and' 
the positions of these characters in the document image 101, and 
predicts character images in the document image 101 on the basis 
of the character codes by using Myocho style font information, 
and outputs predictive character image data PDc. 

The image coding apparatus 100 further includes an image 
composition means 104 which composites the predictive character 
image data PDc on the basis of the auxiliary information 
indicating the sizes and positions of the characters, which 
information is included in the character data Dc, to generate 
predictive document image data PDi corresponding to a predictive 
document image 105 which corresponds to the document image and 
includes only characters. 
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Further, the image coding apparatus 100 includes an entropy 
coding means 10 6 which performs arithmetic coding on the document 
image data Di with reference to the predictive document image 
data PDi to output a code sequence 107 as coded data De of the 
document image. The image coding apparatus 100 outputs, as well 
as the coded data De of the document image, character data Dc of 
the characters included in the document image. In figure 1, 
reference numeral 102 denotes a sequence of characters 
corresponding to the respective character codes included in the 
character data Dc. 

The character data Dc is, for example, extracted from the 
document image data Di by the document recognition means 3901 in 
the conventional document filing apparatus 3900 shown in figure' 
39, and the character data Dc includes auxiliary information 
indicating the character codes corresponding to the respective 
characters included in the document image, the positions of these 
characters in the document image, and the sizes of these 
characters . 

Figure 24(a) is a diagram illustrating X,Y coordinates of 
the above-mentioned document image, and figure 24(b) is a 
schematic diagram for explaining the structure of the character 
data Dc to be input to the predictive image generation means 103. 
The document image 101 includes a character sequence comprising 
Gothic type alphabetical characters "Panasonic Technical Reports" , and 
the character data Dc includes the character codes corresponding 
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to the respective characters constituting this character sequence, 
and data indicating the positions and sizes of the respective 
characters . 

That is, the code sequence 2400 constituting the character 
data Dc includes, for example, code sequences 2410, 2420, 
2430 corresponding to the Myocho style alphabetical characters 
"P", "a", "s", respectively. 

To be specific, the code sequence 2410 is composed of codes 
2411a and 2411b corresponding to the X coordinate and the Y 
coordinate showing the position of the character "P" on the XY 
coordinates with the upper left corner of the document image as 
an original 0, a code 2412 showing the size of the character "P", 
and a character code 2413 corresponding to the character "P". 
Further, the code sequence 2420 is composed of codes 2421a and 
2421b corresponding to the X coordinate and the Y coordinate 
showing the position of the character "a" on the XY coordinates, 
a code 2422 showing the size of the character "a", and a 
character code 2423 corresponding to the character "a". Further, 
the code sequence 2430 is composed of codes 2431a and 2431b 
corresponding to the X coordinate and the Y coordinate showing 
the position of the character "s" on the XY coordinates, a code 

2432 showing the size of the character "s", and a character code 

2433 corresponding to the character "s". 
Next, the operation will be described. 

When the image coding apparatus 100 of this first embodiment 
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receives the binary image data (document image data) Di obtained 
by converting the document image 101 into electronic form by a 
scanner or the like and the character data Dc of the character 
images included in the video image 101, the predictive image 
generation means 103 generates data of predictive character 
images (predictive character image data) PDc corresponding to the 
respective characters included in the document image, from the 
character codes included in the character data Dc, by utilizing 
the font information, and outputs the data to the image 
composition means 104. 

In the image composition means 104, the respective 
predictive character images are composited on the basis of the 
auxiliary information indicating the positions and sizes of the 
respective characters included in the character data Dc, and data 
PDi corresponding to a predictive document image 105 and 
comprising only the predictive character images are output to the 
entropy coding means 10 6. In the predictive document image 105, 
each predictive character image has a predetermined size and is 
arranged in a predetermined position, which size and position are 
decided according to the auxiliary information. 

In the entropy coding means 106, the document image data Di 
is subjected to arithmetic coding with reference to the 
predictive document image data PDi, and a code sequence 107 is 
output as coded data De corresponding to the document image 101. 

Hereinafter, the arithmetic coding process will be described 
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briefly. 

The arithmetic coding is described in more detail in 
"International Standard of Multimedia Coding, Chapter 3, 
Arithmetic Coding, Hiroshi Yasuda, Maruzen Co. Ltd.". 

Figures 25(a), 25(b), and 25(c) are diagrams for explaining 
the principle of the arithmetic coding. 

For example, in the arithmetic coding process, one binary 
decimal is obtained for a combination of pixel values 
corresponding to the respective pixels in a pixel sequence 
comprising a predetermined number of pixels, as coded data of a 
target image (image to be processed) comprising the predetermined 
number of pixels. 

Especially, the arithmetic coding process for binary image 
data employs three symbols "0", "1", and "EOF", and a probability 
model 2504 indicating the probabilities of occurrences of these 
symbols, as shown in figure 25(a). The symbol "0" corresponds to 
a white pixel having a pixel value "0", the symbol "1" 
corresponds to a black pixel having a pixel value "1", and the 
symbol "EOF" indicates the end of the pixel sequence. In the 
probability model 2504, the probability of the symbol "EOF" is x, 
the probability of the symbol "0" is y, and the probability of 
the symbol "1" is z. However, x, y, z are real numbers equal to 
or larger than 0 and smaller than 1, satisfying x+y+z=l. 

Hereinafter, a description will be given of the arithmetic 
coding process for a target image to be processed which comprises 
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two white pixels, with reference to figure 25(b). 

In this case, a symbol sequence 2505 corresponding to the 
pixel sequence comprises symbols "0", "0", and "EOT". 

Initially, the ranges of the probabilities (probability 
ranges) of the respective symbols shown by the probability model 
2504 are assigned onto a number line 2501 indicating a range 
equal to or larger than 0 and smaller than 1. in this case, 
since the first symbol in the symbol sequence 2505 is "0", the 
range of the probability y on the number line 2501 is obtained as 
a limited range Rl . 

Subsequently, the ranges of the probabilities of the 
respective symbols indicated by the probability model 2504 are 
assigned to the limited range Rl on the number line. in this 
case, since the second symbol in the symbol sequence 2505 is "0", 
a part of the limited range Rl corresponding to the probability y 
is obtained as a limited range R2 . 

Finally, the ranges of the probabilities of the respective 
symbols indicated by the probability model 2504 are assigned to 
the limited range R2 on the number line. in this case, since the 
third symbol in the symbol sequence 2505 is "EOF", a part of the 
limited range R2 corresponding to the probability x is obtained 
as a limited range R3 . 

Then, as a binary decimal indicating the limited range R3 on 
the number line 2501, a binary decimal having ten digits on the 
right of the decimal point, "0.0010101011", is obtained as shown 
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in figure 25 (c) , and data indicating this value is output as 
coded data corresponding to the symbol sequence 2505. This 
binary decimal 2503 is a decimal having the smallest number of 
digits, which does not get out of the limited range R3 on the 
number line regardless of the number of digits that follow the 
last digit of the decimal. 

Figure 26 shows the flow of the general arithmetic coding 
process for binary image data. 

When arithmetic coding is started (step S2601), the 
application range R(k) [k: natural number] of the number line to 
which the probability model is applied is initialized to 0^= 
R(1)<1 (step S2602) . When each symbol as one of components of 
the symbol sequence 2505 is input (step S2603) , the range of the 
probability of this symbol in the probability model is assigned 
to the present application range R(k) of the number line, and the 
range of the probability of the inputted symbol in the present 
range R(k) is regarded as a new application range R(k+1) (step 
S2604) . 

Further, in step S2605, it is decided whether the inputted 
symbol is the end symbol or not, and when this is the end symbol, 
the application range limited by the symbol just before the end 
symbol is expressed by a binary decimal, and this binary decimal 
is output (step S2 606) . Thereby, the arithmetic coding is ended 
(step S2607) . 

On the other hand, when it is decided in step S2605 that the 
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inputted symbol is not the end symbol, the next symbol in the 
symbol sequence is input (step S2 603) . If the number of symbols 
in the symbol line is predetermined, the end symbol "EOF" may be 
dispensed with. 

Arithmetic decoding for the coded data corresponding to the 
symbol sequence is performed by deciding the symbol sequence from 
the binary decimal . 

In the above-described arithmetic coding process, there is a 
tendency that the quantity of coded data corresponding to the 
symbol sequence decreases as the error between the probability of 
each symbol in the symbol sequence and the probability of each 
symbol indicated by the probability model becomes smaller, or as 
the deviation in the probabilities of the symbols in the symbol' 
sequence becomes larger. Further, even if the probability model 
is altered while each symbol in one symbol sequence is being 
coded, the coded data of this symbol sequence can be decoded as 
long as the way of this alteration is known. 

Figure 27 is a diagram for explaining a specific method of 
performing arithmetic coding on the image data Di indicating the 
document image 101 with reference to the predictive document 
image 105. 

In this case, a target symbol sequence to be coded comprises 
"0" or "1" pixel values which are obtained by performing 
transverse scanning from left to right of the document image 101, 
on the pixel values of the respective pixels of the document 
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image 101, from the upper side to the lower side of the document 
image 101. 

Then, the process of assigning the range of the probability 
of each symbol, which is given by the probability model, onto the 
number line is performed on all of the symbols in the symbol 
sequence, and data indicating a binary decimal corresponding to 
the limited range on the number line, which is obtained as the 
result of the assignment process, is regarded as coded data 
corresponding to the document image 101. 

In this first embodiment, however, the probability model is 
changed according to the pixel values of the pixels corresponding 
to the target symbol in the predictive document image, for each 
target symbol to be subjected to the assignment process. 

Hereinafter, a description will be specifically given of how 
to change the probability model. 

For example, as the pixels corresponding to the target 
symbol in the predictive document image, there are employed the 
following three pixels: an equivalent-position pixel in the 
predictive document image, which is placed in the relatively 
equal position to the target pixel in the document image, a 
previous pixel positioned before the equivalent-position pixel, 
and a subsequent pixel positioned after the equivalent-position 
pixel . 

The previous and subsequent pixels are positioned before and 
after the equivalent-position pixel in a pixel sequence obtained 
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by subjecting the predictive document image to scanning identical 
to the scanning performed on the document image. 

The combination of the pixel values of these three pixels 
has eight patterns as follows, and each pattern is associated 
with a probability model in which the probabilities of white 
pixel, black pixel, and EOF are set. 
(First Pattern) 

All of the previous pixel, the equivalent-position pixel, 
and the subsequent pixel are white pixels. 

In the probability model corresponding to this first pattern, 
the probability ranges for EOF, while pixel, and black pixel are 
set to [0, 0.05), [0.05, 0.95), and [0.95, 1.0), respectively. 
(Second Pattern) 

The previous pixel is a black pixel, and the equivalent- 
position pixel and the subsequent pixel are white pixels. 

In the probability model corresponding to this second 
pattern, the probability ranges for EOF, while pixel, and black 
pixel are set to [0, 0.05), [0.05, 0.75), and [0.75, 1.0), 
respectively. 
(Third Pattern) 

The previous pixel and the equivalent-position pixel are 
white pixels, and the subsequent pixel is a black pixel. 

In the probability model corresponding to this third pattern, 
the probability ranges for EOF, while pixel, and black pixel are 
set to [0, 0.05), [0.05, 0.7), and [0.7, 1.0), respectively. 
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(Fourth Pattern) 

The previous pixel and the subsequent pixel are white pixels 
and the equivalent-position pixel is a black pixel. 

In the probability model corresponding to this fourth 
pattern, the probability ranges for EOF, while pixel, and black 
pixel are set to [0, 0.05), [0.05, 0.65), and [0.65, 1.0), 
respectively. 
(Fifth Pattern) 

The previous pixel and the subsequent pixel are black pixels 
and the equivalent-position pixel is a white pixel. 

In the probability model corresponding to this fifth pattern 
the probability ranges for EOF, while pixel, and black pixel are 
set to [0, 0.05), [0.05, 0.45), and [0.45, 1.0), respectively. ' 
(Sixth Pattern) 

The previous pixel and the equivalent-position pixel are 
black pixels, and the subsequent pixel is a white pixel. 

In the probability model corresponding to this sixth pattern 
the probability ranges for EOF, while pixel, and black pixel are 
set to [0, 0.05), [0.05, 0.4), and [0.4, 1.0), respectively. 
(Seventh Pattern) 

The previous pixel is a white pixel, and the equivalent- 
position pixel and the subsequent pixel are black pixels. 

In the probability model corresponding to this seventh 
pattern, the probability ranges for EOF, while pixel, and black 
pixel are set to [0, 0.05), [0.05, 0.35), and [0.35, 1.0), 
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respectively. 
(Eighth Pattern) 

All of the previous pixel, the equivalent-position pixel, 
and the subsequent pixel are black pixels. 

In the probability model corresponding to this eighth 
pattern, the probability ranges for EOF, while pixel, and black 
pixel are set to [0, 0.05), [0.05, 0.15), and [0.15, 1.0), 
respectively. 

For example, in the process of assigning the probability 
range onto the number line with respect to the target pixel 2701 
in the document image 101 shown in figure 27, since the 
equivalent-position pixel in the corresponding predictive 
document image is a white pixel and its previous and subsequent' 
pixels are a black pixel and a white pixel, respectively, the 
probability model set for the above-described second pattern is 
used. In this case, since the target pixel is a white pixel, a 
range indicated by [0.05, 0.75) in the present limited range on 
the number line becomes a new limited range. 

The process of limiting the probability range on the number 
line while changing the probability model according to the pixel 
value of each pixel in the predictive document image is performed 
on each pixel of the document image, from the head pixel to the 
EOF. Thereby, a binary decimal indicating the finally limited 
probability range is output as an entropy code (coded data) 
corresponding to the document image . 
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As described above, according to the first embodiment of the 
invention, the predictive document image 105 corresponding to the 
document image 101 is created on the basis of the character data 
Dc extracted from the data Di of the document image 101, and the 
document image data Di is subjected to the arithmetic coding 
process in which the probability model is changed with reference 
to the predictive document image data PDi . Therefore, the 
probabilities of white pixel and black pixel indicated by the 
probability model become very near to those in the document image, 
whereby the coding efficiency for the document image data in the 
arithmetic encoder is improved. 

Further, in the character data Dc, each character in the 
document image includes one character code. Therefore, character 
data obtained by character recognition for the document image is 
prevented from being redundant . 
(Embodiment 2) 

Figure 2 is a block diagram illustrating the structure of an 
image coding apparatus according to a second embodiment of the 
present invention. This second embodiment corresponds to Claim 2 
especially. 

An image coding apparatus 200 according to this second 
embodiment is used as an image coding means in a data processing 
apparatus which performs storage and transmission/reception of 
image data, for example, an electronic device having a scanner, 
such as the document filing unit 3900 shown in figure 39 or a 



76 



facsimile . 

The image coding apparatus 200 of this second embodiment 
includes an image feature extraction means 202 which receives 
document image data Di {binary image data obtained by converting 
a document image 201 into electronic form with a scanner or the 
like) , and extracts character data Dc comprising a code sequence 
2400 as shown in figure 24(b) from the document image data Di . 
This image feature extraction means 202 is a character 
recognition apparatus performing character recognition by a 
general method used by an OCR or the like, and the character data 
Dc includes character codes (image features) corresponding to the 
respective character images in a character sequence 203 in the 
document image, and auxiliary information indicating the 
positions and sizes of the respective characters in the document 
image . 

The image coding apparatus 200 further includes, like the 
image coding apparatus 100 of the first embodiment, a predictive 
image generation means 204 which predicts character images 
corresponding to the respective characters in the document image 
on the basis of the character codes included in the character 
data Dc, and outputs the data (predictive character image data) 
PDc; and an image composition means 205 which arranges the 
predictive character images corresponding to the respective 
characters in a predetermined image space on the basis of the 
predictive character image data PDc and the auxiliary information 
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which indicates the positions and sizes of the characters, and 
generates a predictive document image 20 6 comprising the 
predictive character images corresponding to the respective 
characters, and outputs the data (predictive document image 
data ) PDi. 

Further, the image coding apparatus 200 includes an entropy 
coding means 207 which performs arithmetic coding on the document 
image data Di with reference to the predictive document image 
data PDi by utilizing the correlation between the predictive 
document image 206 and the document image 201, and outputs a code 
sequence 208 as coded data De corresponding to the document image. 
The image coding apparatus 200 outputs, as well as the coded data 
De corresponding to the document image, character data Dc 
corresponding to the characters included in the document image. 

The predictive image generation means 204, the image 
composition means 205, and the entropy coding means 207 in the 
image coding apparatus 200 of this second embodiment are 
identical to the predictive image generation means 103, the image 
composition means 104, and the entropy coding means 10 6 
constituting the image coding apparatus 100 of the first 
embodiment . 

Next, the operation will be described. 

As described for the first embodiment, the document image 
data Di to be coded is binary image data obtained by converting 
the document image 201 into electronic form with a scanner or the 
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like, and the document image 201 includes, as its partial images, 
character images each comprising a character, symbol, or a part 
of a character or symbol. 

When the document image data Di is input to the image coding 
apparatus 200 of this second embodiment, the image feature 
extraction means 202 extracts, from the document image data Di, 
the character codes corresponding to the respective characters in 
the document image 201, and the auxiliary information indicating 
the positions and sizes of the characters in the document image, 
and outputs the character data Dc including the character code 
and the auxiliary information to the predictive image generation 
means 204. The construction of the character data Dc is 
identical to that shown in figure 24(b). Further, the image 
feature extraction means 202 is a character recognition apparatus 
which performs recognition on the characters included in the 
document image by a general method employed for OCR or the like, 
and in this second embodiment, description for specific 
extraction method is omitted. 

In the predictive image generation means 204, data of 
predictive character images (predictive character image data PDc) 
corresponding to the respective characters included in the 
document image are generated from the character codes included in 
the character data Dc by utilizing the font information, and the 
generated data PDc are output to the image composition means 205. 
In the image composition means 205, the predictive character 
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images are composited on the basis of the auxiliary information 
included in the character data Dc, and data corresponding to the 
predictive document image 20 6 (predictive document image data 
PDi) is output to the entropy coding means 207. In the 
predictive document image 206, each predictive character image 
having a predetermined size is arranged in a predetermined 
position, which size and position depend on the auxiliary 
information . 

In the entropy coding means 207, as in the entropy coding 
means of the first embodiment, the electronic data of the 
document image 2 01, i.e., the document image data Di, is 
subjected to arithmetic coding with reference to the predictive 
document image data PDi, and the corresponding code sequence 208 
is output as coded data De . 

As described above, the image coding apparatus 200 of this 
second embodiment is provided with the image feature extraction 
means 202 for extracting the character data Dc from the document 
image data Di, in addition to the constituents of the image 
coding apparatus 100 of the first embodiment. Therefore, in 
addition to the effect of the first embodiment that the coding 
efficiency is improved without degrading the facility in 
retrieving the document image, extraction of the character data 
Dc from the character image data Di is automatically carried out, 
whereby an image coding apparatus available as an image coding 
means in a facsimile or the like is obtained. 
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Further, since the image feature extraction means 202 
extracts, as the character data Dc, one character code for each 
character in the document image, the character data obtained by 
character recognition on the document image is prevented from 
being redundant. 
(Embodiment 3) 

Figure 3 is a block diagram for explaining an image decoding 
apparatus according to a third embodiment of the present 
invention. This third embodiment corresponds to Claim 5. 

An image decoding apparatus 300 of this third embodiment 
corresponds to the image coding apparatus 100 or 200 according to 
the first or second embodiment, and is used as an image decoding 
means in the document filing apparatus 3900 shown in figure 39 or 
in a facsimile. 

That is, the image decoding apparatus 300 receives coded 
data De and character data Dc outputted from the image coding 
apparatus 100 or 200 according to the first or second embodiment, 
and decodes the coded data De on the basis of the character data 
Dc to restore document image data Di corresponding to a document 
image 301 as decoded data Dd corresponding to a document image 
307. 

To be specific, the image decoding apparatus 300 of this 
third embodiment includes a predictive image generation means 303 
which receives the character data Dc corresponding to the 
respective characters in the character sequence 302, predicts 
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character images in the document image on the basis of the 
character codes (image features) included in the character data 
Dc by utilizing the font information, and outputs the data of the 
predictive character images (predictive character image data 
PDc) ; and an image composition means 304 which composites the 
predictive character image data PDc on the basis of the auxiliary 
information indicating the positions and sizes of the respective 
characters and included in the character data Dc to generate 
predictive document image data PDi corresponding to a predictive 
document image 305 including only characters corresponding to the 
document image . 

Further, the image decoding apparatus 300 includes an 
entropy decoding means 306 which receives, as a code sequence 301, 
coded data De that is obtained by arithmetic coding utilizing the 
correlation between the predictive document image and the 
document image, performs arithmetic decoding on the coded data De 
with reference to the predictive document image data PDi, and 
outputs document image data Dd corresponding to the document 
image 307. 

Hereinafter, the operation will be described. 

When the coded data De and the character data Dc are input 
to the image decoding apparatus 300 of this third embodiment, the 
predictive image generation means 303 generates data of 
predictive character images (predictive character image data) PDc 
corresponding to the respective characters included in the 
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document image, from the character codes included in the 
character data Dc by utilizing the font information, and outputs 
the data to the image composition means 304. In the image 
composition means 304, the respective predictive character images 
are composited on the basis of the auxiliary information included 
in the character data Dc, and data PDi corresponding to a 
predictive document image 305 is output to the entropy decoding 
means 30 6. 

In the entropy decoding means 306, the coded data De is 
subjected to arithmetic decoding with reference to the predictive 
document image data PDi, and document image data Dd corresponding 
to the document image 307 is output. 

Like the entropy coding means according to the first or 
second embodiment, the entropy decoding means 30 6 performs 
switching of the probability model, and decoding on the coded 
data outputted from the entropy encoder. 

For example, when the combination of the pixel values of 
three pixels in the predictive document image corresponding to 
these pixels in the document image is the second pattern 
described for the first embodiment, the entropy decoding means 
306 employs the probability model in which the probability ranges 
of EOF, white pixel, and black pixel are set at [0, 0.05), [0.05, 
0.75), and [0.75, 1.0), respectively. 

As described above, in the image decoding apparatus 300 
according to the third embodiment, a predetermined document image 
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is predicted on the basis of character data Dc corresponding to 
characters included in the predetermined document image to 
generate data PDi corresponding to a predictive document image, 
and coded data De of the predetermined document image is 
subjected to arithmetic decoding with reference to the predictive 
document image data PDi. Therefore, it is possible to realize a 
decoding process adapted to the efficient arithmetic coding 
process performed on the document image data Di using the 
predictive document image data PDi . 

Further, the image decoding apparatus 300 of this third 
embodiment can to applied to a facsimile or a document filing 
apparatus, in conjunction with the image coding apparatus 200 of 
the second embodiment . 

Hereinafter, a brief description will be given of a 
facsimile provided with the image coding apparatus of the second 
embodiment and the image decoding apparatus of the third 
embodiment . 

Figure 41(a) is a block diagram for explaining a facsimile 
10 as described above. 

The facsimile 10 includes a scanner 11 which reads a 
document image 201 to output electronic data (document image 
data) Di; an image coding unit 2 0 0a which performs coding on the 
document image data Di to output coded data De and character data 
Dc corresponding to characters included in the document image ; 
and a transmitter-receiver 12 which combines the coded data De 
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with the relating character data Dc, and transmits /receives 
composite data Dm including the coded data De and the character 
data Dc through a telephone line 15. The image coding unit 200a 
is identical in structure to the image coding apparatus 200 
according to the second embodiment. 

The facsimile 10 further includes an image decoding unit 
300a which receives the coded data De and the character data Dc 
included in the composite data Dm received by the transmitter- 
receiver 12 through the telephone line 15, and decodes the coded 
data De on the basis of the character data Dc to output document 
image data Dd; and an image output unit 13 which performs display 
or printout of the document image on the basis of the document 
image data Dd. The image decoding unit 300a is identical in 
structure to the image decoding apparatus 300 according to the 
third embodiment. 

In the facsimile 10 so constructed, the electronic data of 
the document image 201 (document image data Di) can be 
efficiently converted to coded data using the character data 
corresponding to the characters included in the document image by 
the image coding unit 2 00a and, further, the coded data De 
outputted from the image coding unit 200a, to which the data Dc 
for document image retrieval is added, can be transmitted. 

Further, when the facsimile 10 receives the composite data 
including the character data Dc and the coded data De which is 
obtained by coding the document image data Di using the character 
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data Dc, the coded data De can be correctly decoded using the 
character data Dc. 

Next, a brief description will be given of a document filing 
apparatus provided with the image coding apparatus of the second 
embodiment and the image decoding apparatus of the third 
embodiment . 

Figure 41 (b) is a block diagram for explaining a document 
filing apparatus 20 as described above. 

The document filing apparatus 20 includes a scanner 21 which 
reads a document image 201 to output electronic data (document 
image data) Di; an image coding unit 200a which performs coding 
on the document image data Di to output coded data De and 
character data Dc corresponding to characters included in the 
document image; and a document image storage means 22 which 
stores the coded data De and the corresponding character data Dc 
in association with each other. The image coding unit 2 00a is 
identical in structure to the image coding apparatus 200 
according to the second embodiment. 

The document filing apparatus 20 further includes a data 
reading means 23 which reads coded data De corresponding to a 
predetermined image stored in the document image storage means 22, 
together with the corresponding character data Dc, on the basis 
of character codes inputted as retrieval data Da from the 
outside; an image decoding unit 300a which decodes the read coded 
data De us ing the character data Dc to restore the document image 
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data Di corresponding to the predetermined document image; and an 
image output unit 13 which performs display or printout of the 
document image on the basis of the document image data Dd. The 
image decoding unit 300a is identical in structure to the image 
decoding apparatus 300 according to the third embodiment. 

In the document filing apparatus 20 so constructed, the 
electronic data of the document image 201 (document image data 
Di) can be efficiently converted to coded data using the 
character data corresponding to the characters included in the 
document image by the image coding unit 200a and, further, the 
coded data De outputted from the image coding unit 200a, to which 
the data Dc for document image retrieval, can be stored. 

Further, in the document filing apparatus 20, it is possible 
to read the coded data De, which is obtained by coding the 
document image data Di using the character data Dc, from the 
document image storage means by collating the retrieval data 
inputted from the outside with the character data Dc. 
(Embodiment 4) 

Figure 4 is a block diagram illustrating the structure of an 
image coding apparatus according to a fourth embodiment of the 
present invention. This fourth embodiment corresponds to Claim 3. 

An image coding apparatus 400 according to this fourth 
embodiment is used as an image coding means in a data processing 
apparatus performing storage and transmission/reception of image 
data, for example, an electronic device having a scanner, such as 



87 



the document filing apparatus 3900 shown in figure 39 or a 
facsimile . 

The image coding apparatus 400 of this fourth embodiment 
includes an image feature extraction means 402 which receives 
document image data Di (binary image data obtained by converting 
a document image 401 into electronic form with a scanner or the 
like) , and extracts character data Dc from the document image 
data Di; a predictive image generation means 404 which outputs 
predictive character image data PDc on the basis of character 
codes included in the character data Dc; and an image composition 
means 404 which generates a predictive document image 406 
including predictive character images corresponding to the 
respective characters, on the basis of the predictive character 
image data PDc and auxiliary information included in the 
character data Dc, and outputs its data (predictive document 
image data) PDi. 

The image feature extraction means 402, the predictive image 
generation means 404, and the image composition means 405 are 
identical to the corresponding means 202, 204, and 205 of the 
image coding apparatus 200 according to the second embodiment. 

The image coding apparatus 400 further includes a first 
image blocking means 408 which divides the predictive document 
image 4 06 into image spaces each having a predetermined size 
(predictive document image blocks) , and outputs image data 
(predictive block data) BPDi for each block; and a second image 



blocking means 407 which divides the document image 401 into 
image spaces having a predetermined size (document image blocks) , 
and' outputs image data (block data) BDi for each block. Each of 
the document image blocks and the predictive document image 
blocks is an image space comprising 16X16 pixels. 

Furthermore, the image coding apparatus 4 00 includes a block 
predictive coding means 409 which compares pixel values between 
the predictive document image block and the document image block 
on the basis of the predictive block data BPDi and the block data 
BDi, and performs arithmetic coding on the block data BDi using 
the predictive block data BPDi when a difference in pixel values 
compared is larger than a predetermined value, and outputs coded 
data BDe and a coding flag Fcl. On the other hand, when a 
difference in pixel values compared between the predictive 
document image block and the document image block is smaller than 
the predetermined value, the block predictive coding means 409 
does not perform arithmetic coding on the block data BDi, and 
outputs a non-coding flag FcO. 

Next, the operation will be described. 

The document image data Di to be coded is binary image data 
obtained by converting the document image 401 into electronic 
form using a scanner or the like, and the document image 401 
includes, as partial images, character images each comprising a 
character or a symbol, or a part of a character or symbol. 

When the document image data Di is input to the image coding 
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apparatus 400 of the fourth embodiment, the image feature 
extraction means 402 extracts, from the document image data Di, 
character codes corresponding to the respective characters in the 
document image 401 and auxiliary information indicating the 
positions and sizes of the characters in the document image, and 
outputs character data Dc including the character codes and the 
auxiliary information to the predictive image generation means 
404. 

In the predictive image generation means 404, predictive 
character image data PDc is generated from the character codes 
included in the character data Dc, and the data so generated is 
output to the image composition means 405. In the image 
composition means 405, the respective predictive character images 
are composited on the basis of the auxiliary information, and 
data corresponding to a predictive document image 40 6 (predictive 
document image data) PDi is output to the first image blocking 
means 4 08. 

In the first image blocking means 408, the predictive 
document image is divided into blocks each having a predetermined 
size on the basis of the predictive character image data PDc, and 
predictive block data BPDi corresponding to each block is output 
to the block predictive coding means 409. 

At this time, the document image data Di is output to the 
second image blocking means 407, wherein the document image is 
divided into blocks each having a predetermined size on the basis 
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of the character image data Dc, and block data PDi corresponding 
to each block is output to the block predictive coding means 409. 

In each blocking means, the predictive document image or the 
document image is divided into blocks each comprising 16X16 
pixels . 

In the block predictive coding means 409, the block data BDi 
is subjected to arithmetic coding with reference to the 
predictive block data BPDi, on the basis of the predictive block 
data BPDi and the block data BDi. 

Figure 28 is a diagram illustrating the flow of the coding 
process performed by the block predictive coding means 409. 

Initially, the data BDi of a document image block outputted 
from the second blocking means 407 is read into the block 
predictive coding means 409 (step S2802) , and the data BPDi of 
the corresponding predictive document image block is read into 
the coding means 409 (step S2803) . 

Next, differences in pixel values of corresponding pixels 
are obtained between the read blocks, and the sum of the absolute 
values of these differences is calculated (step S2804) . When the 
absolute value of the difference is equal to or larger than a 
threshold (in this case, the threshold is 7) , it is decided that 
the prediction error is large; on the other hand, when it is 
smaller than the threshold (in this case, 7), it is decided that 
the prediction error is small (step S2805) . 

Based on the result of the decision, when the prediction 
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error is equal to or larger than the threshold, a coding flag Fcl 
having a value "1" is output from the block predictive coding 
means 409 (step S2806) , and the image data of the document image 
block is subjected to arithmetic coding with reference to the 
image data of the predictive document image block, whereby coded 
data De of the document image block is output (step S2808) . 

On the other hand, when the decision in step S2805 is that 
the prediction error is smaller than the threshold, a non-coding 
flag FcO having a value "0" is output from the block predictive 
coding means 409 (step S2807) . 

Then, it is decided whether or not a target block, which is 
being processed by the block predictive coding means 409, is the 
last document image block in the document image (step S2809) . 
When the target block is the last document image block, the 
coding process is ended (step S2810) . When the target block is 
not the last document image block, the following block is 
subjected to the processes in steps S2802 through S2809. 

Figure 29 shows the form of composite data MDe including 
coded data BDe and flags Fcl and FcO corresponding to the 
respective image blocks, which is output from the block 
predictive coding means 409. 

This composite data MDe includes code sequences B(l), B(2), 
B(3), B(4), B(5), B(n) corresponding to the first, second, 

third, fourth, fifth, n-th image blocks, respectively. 

The code sequences B(l), B(3), B(4), B(n) are composed 
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of non-coding flags FcO having values "0", and the code sequences 
B(2) and B(5) are composed of coding flags Fcl having values "1" 
and arithmetic codes BDe corresponding to the data of the second 
and fifth image blocks, respectively. 

As described above, according to the fourth embodiment, a 
predictive document image is generated on the basis of character 
data corresponding to characters included in a document image, 
and the predictive document image is divided into predictive 
document blocks each having a predetermined size. Further, the 
document image is divided into document blocks each having a 
predetermined size, and image data of each document block is 
subjected to arithmetic coding with reference to image data of 
the corresponding predictive document block. At this time, a 
difference in pixel values between each document block and the 
corresponding predictive document block is compared with a 
predetermined threshold, and only the coded data of document 
blocks having the differences larger than the threshold are 
transmitted. Therefore, the coding efficiency is greatly 
improved by neglecting small differences in the block by block 
comparison, without giving, to the viewer, the impression that 
the image quality is degraded. 
(Embodiment 5) 

Figure 5 is a block diagram illustrating the structure of an 
image decoding apparatus according to a fifth embodiment of the 
present invention. This fifth embodiment corresponds to Claim 6 
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especially. 

An image decoding apparatus 500 of this fifth embodiment is 
adaptable to the image coding apparatus 400 of the fourth 
embodiment/ and it is used as an image decoding means in an 
electronic device having a scanner, such as the document filing 
apparatus 3900 shown in figure 39 or a facsimile. 

That is, the image decoding apparatus 500 receives the 
composite data MDe and the character data Dc outputted from the 
image coding apparatus 400 of the fourth embodiment, and decodes 
the coded block data BDe included in the composite data MDe on 
the basis of the character data Dc and the flags Fcl and FcO 
included in the composite data MDe to restore the document image 
data Di corresponding to the document image 509. 

To be specific, the image decoding apparatus 500 includes a 
predictive image generation means 503 which receives the 
character data Dc corresponding to the respective characters in 
the character sequence 502, predicts character images in the 
document image on the basis of the character codes (image 
features) included in the character data Dc by utilizing the font 
information, and outputs predictive character image data PDc for 
displaying predictive character images; and an image composition 
means 5 04 which composites the predictive character image data 
PDc on the basis of the auxiliary information indicating the 
positions and sizes of the respective characters and included in 
the character data Dc to generate predictive document image data 
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PDi corresponding to a predictive document image 505 including 
only characters corresponding to the document image. 

The image decoding apparatus 500 further includes an image 
blocking means 506 which receives the predictive document image 
data PDi, and divides the predictive document image 505 into 
image spaces each having a predetermined size (predictive 
document image blocks), and outputs image data (predictive block 
data) BPDi corresponding to each block; and a block predictive 
decoding means 507 which performs arithmetic decoding on the 
coded block data BDe by using the corresponding predictive 
document block data BPDi, and outputs decoded block data BDd 
corresponding to the restored document block. 

The image decoding apparatus 500 further includes an image 
block assembly means 508 which receives the decoded block data 
BDd and the predictive block data BPDi, assembles the predictive 
document blocks and the decoded document blocks on the basis of 
the flags Fcl and FcO, and outputs document image data Dd 
corresponding to the document image 509. 

Each of the document blocks, predictive document blocks, and 
decoded document blocks is an image space comprising 16X16 
pixels . 

The predictive image generation means 503 and the image 
composition means 104 are identical to the predictive image 
generation means 103 and the image composition means 104 
according to the first embodiment, respectively, and the image 
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blocking means 506 is identical to the first image blocking means 
408 according to the fourth embodiment. 

Next, the operation will be described. 

When the coded data MDe and the character data Dc are input 
to the image decoding apparatus 500, the predictive image 
generation means 503 generates data of predictive character 
images (predictive character image data) PDc corresponding to the 
respective characters included in the document image from the 
character codes included in the character data Dc by utilizing 
the font information, and outputs the data so generated to the 
image composition means 504. In the image composition means 504, 
the respective predictive character images are composited on the 
basis of the auxiliary information included in the character data 
Dc, and the data PDi corresponding to the predictive document 
image 505 is output to the image blocking means 506. 

In the image blocking means 50 6, the predictive document 
image is divided into blocks each having a predetermined size on 
the basis of the predictive character image data PDc, and 
predictive block data BPDi corresponding to each block is output 
to the block predictive decoding means 507. 

In the block predictive decoding means 507, the block data 
BDi included in the composite data MDe is subjected to arithmetic 
decoding using the predictive block data BPDi on the basis of the 
predictive block data BPDi and the composite data MDe, whereby 
the image data BDd of the corresponding document image block is 
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restored. 

Further, when the image data BDd and the data BPDi of the 
predictive image blocks are input to the image block assembly 
means 508, the predictive image blocks and the decoded image 
blocks are assembled on the basis of the flags Fcl and FcO 
corresponding to the respective blocks included in the composite 
data MDe, whereby the image data Dd corresponding to the document 
image 509 is restored. 

Hereinafter, the decoding process performed by the block 
predictive decoding means 507 will be described specifically. 

Figure 30 is a diagram illustrating the flow of the decoding 
process performed by the block predictive decoding means 507. 

Initially, the coded data BDe corresponding to each block of 
the document image is read into the block predictive decoding 
means 507 (step S3002) , and the data BPDi of the corresponding 
predictive document image block outputted from the image blocking 
means 506 is read into the coding means 507 (step S3003) . 

Subsequently, it is decided whether the flag included in the 
composite data MDe is a coding flag Fcl or a non-coding flag FcO 
(step S3004) . When the flag is a coding flag, the decoding means 
507 performs decoding on the arithmetic-coded data DBe which 
follows the coding flag, with reference to the data BPDi of the 
predictive document image block (step S3005) , and outputs the 
data BDd of the decoded block (step S3006) . 

On the other hand, when it is decided in step S3004 that the 
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flag is a non-coding flag, the data BPDi of the predictive 
document image block is output as it is (step S3007) . 

Then, it is decided whether or not a target block, which is 
being processed by the block predictive decoding means, is the 
last image block in the document image (step S3008) . When the 
target block is the last image block, the decoding process is 
ended (step S3009) . When the target block is not the last image 
block, the following block is subjected to the processes in steps 
S3002 through S3008. 

Thereafter, in the image block assembly means 508, the image 
blocks, which are input block by block, are successively placed 
in predetermined image spaces, whereby the image data Dd 
corresponding to the document image 509 is restored. 

As described above, according to this fifth embodiment, a 
predictive document image is created from character information 
which has previously been extracted from a document image, and 
this predictive document image is divided into predictive 
document blocks each having a predetermined size to generate data 
BPDi corresponding to each predictive image block. Further, 
coded data BDe corresponding to each of image blocks having a 
predetermined size, which are obtained by dividing the document 
image, is subjected to arithmetic decoding with reference to the 
data BPDi of the corresponding predictive image block. At this 
time, with respect to a document image block having a relatively 
small prediction error, which has not been coded, the data of the 
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corresponding predictive document image block is output. 
Therefore, it is possible to realize a decoding process adapted 
to the efficient block-by-block coding process for the document 
image data Di with reference to the predictive document image 
data PDi. 

Further, a facsimile provided with the image coding 
apparatus 400 of the fourth embodiment and the image decoding 
apparatus 50 0 of the fifth embodiment is realized by replacing 
the image coding unit 200a and the image decoding unit 300a in 
the facsimile shown in figure 41(a) with the image coding 
apparatus 400 and the image decoding apparatus 500, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 400 of the fourth embodiment and the image 
decoding apparatus 500 of the fifth embodiment is realized by 
replacing the image coding unit 200a and the image decoding unit 
300a in the document filing apparatus shown in figure 41 (b) with 
the image coding apparatus 400 and the image decoding apparatus 
500, respectively. 
(Embodiment 6) 

Figure 6 is a block diagram illustrating the structure of an 
image coding apparatus according to a sixth embodiment of the 
present invention. This sixth embodiment corresponds to Claim 4. 

An image coding apparatus 600 according to this sixth 
embodiment is used as an image coding means in a data processing 
apparatus performing storage and transmission/reception of image 
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data, for example, an electronic device having a scanner, such as 
the document filing apparatus 3900 shown in figure 39 or a 
facsimile . 

The image coding apparatus 600 of this sixth embodiment 
includes an image feature extraction means 602 which receives 
document image data Di (binary image data obtained by converting 
a document image 601 into electronic form with a scanner or the 
like), and extracts character data Dc from the document image 
data Di; a predictive image generation means 604 which outputs 
predictive character image data PDc on the basis of character 
codes included in the character data Dc; and an image composition 
means 605 which generates a predictive document image 60 6 
including predictive character images corresponding to the 
respective characters, on the basis of the predictive character 
image data PDc and auxiliary information included in the 
character data Dc, and outputs its data (predictive document 
image data) PDi . 

The image coding apparatus 600 further includes an image 
filtering means 607 which subjects the predictive document image 
data PDi to filtering such as morphological filtering or 
smoothing so that minute parts of the predictive document image 
60 6 are omitted, and outputs filtered data FPDi; and an entropy 
coding means 608 which subjects the document image data Di to 
arithmetic coding with reference to the filtered data FPDi by 
utilizing the correlation between the filtered predictive 
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document image 606 and the document image 601, and outputs a code 
sequence 609 as coded data De. 

The image feature extraction means 602, the predictive image 
generation means 604, the image composition means 605, and the 
entropy coding means 608 are identical to the corresponding means 
202, 204, 205, and 207 of the image coding apparatus 200 
according to the second embodiment, respectively. 

Next, the operation will be described. 

The document image data Di to be coded is binary image data 
obtained by converting the document image 601 into electronic 
form using a scanner or the like, and the document image 601 
includes, as partial images, character images each comprising a 
character or a symbol, or a part of a character or symbol. 

When the document image data Di is input to the image coding 
apparatus 600 of this sixth embodiment, the image feature 
extraction means 602, the predictive image generation means 604, 
and the image composition means 605 perform the same processes as 
those described for the image feature extraction means 2 02, the 
predictive image generation means 204, and the image composition 
means 205 according to the second embodiment, and the image data 
of the predictive document image 606 (predictive document image 
data) PDi outputted from the image composition means 605 is input 
to the image filtering means 607. 

In the image filtering means 607, the predictive document 
image data PDi is subjected to filtering using a morphological 
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filter so that the minute parts of the predictive document image 
60 6 are omitted. 

Figure 31 is a schematic diagram for explaining the process 
using the morphological filter. 

In the morphological filter 3102, a region 3102a of a 
predetermined size (a mask of 3X3 pixels) with a target pixel 
3101a to be filtered on the predictive document image being in 
the center, is set for each of the respective pixels constituting 
the predictive document image, and the pixel value of the target 
pixel 3101a is replaced with the maximum pixel value of the 
pixels within the mask. 3101b denotes a pixel having the maximum 
pixel value within the mask. 

For example, assuming that the predictive document image is 
a monochrome image, in the predictive document image 3103 after 
the filtering process, its minute parts are omitted as compared 
with the predictive document image 3101 before the filtering 
process, and the black region is extended, as shown in figure 31. 

In the entropy coding means 608, the data Di of the document 
image 601 is subjected to arithmetic coding with reference to the 
filtered predictive document image data FPDi, and the 
corresponding code sequence 60 9 is output as coded data De . 

As described above, according to the sixth embodiment, a 
predictive document image corresponding to the document image is 
generated on the basis of the character data extracted from the 
document image data, and the predictive document image data is 
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subjected to filtering, and the document image data is subjected 
to arithmetic coding with reference to the filtered predictive 
document image data. Therefore, the prediction error of the 
predictive document image to the document image is reduced by the 
filtering process, whereby the coding efficiency for the document 
image data by the arithmetic encoder is further improved. 
(Embodiment 7) 

Figure 7 is a block diagram illustrating the structure of an 
image decoding apparatus according to a seventh embodiment of the 
present invention. This seventh embodiment corresponds to Claim 
7 especially. 

An image decoding apparatus 700 of this seventh embodiment 
is adaptable to the image coding apparatus 600 of the sixth 
embodiment, and it is used as an image decoding means in an 
electronic device having a scanner, such as the document filing 
apparatus 3900 shown in figure 39 or a facsimile. 

That is, the image decoding apparatus 700 receives the coded 
data De and the character data Dc outputted from the image coding 
apparatus 600 of the sixth embodiment, and decodes the coded data 
De on the basis of the character data Dc to restore the document 
image data Di of the document image 701, as decoded data Dd of 
the document image 708. 

To be specific, the image decoding apparatus 700 includes a 
predictive image generation means 703 which receives the 
character data Dc corresponding to the respective characters in 
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the character sequence 702, predicts character images in the 
document image on the basis of the character codes (image 
features) included in the character data Dc by utilizing the font 
information, and outputs the predictive character image data PDc 
for displaying the predictive character images; and an image 
composition means 7 04 which composites the predictive character 
image data PDc on the basis of the auxiliary information 
indicating the positions and sizes of the respective characters 
and included in the character data Dc to generate predictive 
document image data PDi corresponding to a predictive document 
image 705 including only characters corresponding to the document 
image . 

The image decoding apparatus 700 further includes an image 
filtering means 70 6 which subjects the predictive document image 
data PDi to filtering such as morphological filtering or 
smoothing so that minute parts of the predictive document image 
705 are omitted, and outputs the filtered data FPDi; and an 
entropy coding means 708 which receives, as a code sequence 701, 
coded data De obtained by performing arithmetic coding utilizing 
the correlation between the predictive document image and the 
document image, and subjects the coded data De to arithmetic 
decoding using the filtered predictive document image data, i.e., 
the filtered output FPDi, and outputs document image data 
(decoded data) Dd corresponding to the document image 708. 

The predictive image generation means 703, the image 
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composition means 704, and the entropy decoding means 707 are 
identical to the corresponding means 303, 304, and 306 of the 
image decoding apparatus 300 according to the third embodiment. 
Next, the operation will be described. 

When the coded data De and the character data Dc are input 
to the image decoding apparatus 700, the predictive image 
generation means 703 and the image composition means 7 04 perform 
the same processes as those described for the predictive image 
generation means 303 and the image composition means 304 of the 
third embodiment, and image data (predictive document image data) 
PDi corresponding to the predictive document image 705 and 
outputted from the image composition means 704 is input to the 
image filtering means 706. 

In the image filtering means 706, the predictive document 
image data PDi is subjected to the same filtering as that 
performed by the image filtering means 607 in the image coding 
apparatus 600 of the sixth embodiment, and filtered data 
(predictive document image data which has been filtered) FPDi is 
output . 

In the entropy decoding means 707, the coded data De is 
decoded with reference to the filtered predictive document image 
data FPDi, and document image data Dd corresponding to the 
document image 708 is output. 

The process performed by the entropy decoding means 707 is 
identical to that performed by the entropy decoding means 306 of 



the third embodiment except that decoding is performed with 
reference to not the predictive document image data as it is but 
the predictive document image data which has been filtered by the 
image filtering means 706. 

As described above, according to the seventh embodiment, a 
predictive document image is generated from character information 
previously extracted from a document image, and predictive 
document image data is subjected to filtering so that minute 
ports of the predictive document image are omitted. Then, the 
coded data De corresponding to the document image is subjected to 
arithmetic decoding with reference to the filtered predictive 
document image data FPDi . Therefore, it is possible to realize a 
decoding process adaptable to an efficient coding process for 
document image data Di with reference to filtered predictive 
document image data FPDi . 

Further, a facsimile provided with the image coding 
apparatus 600 of the sixth embodiment and the image decoding 
apparatus 500 of the seventh embodiment is realized by replacing 
the image coding unit 2 00a and the image decoding unit 300a in 
the facsimile shown in figure 41(a) with the image coding 
apparatus 600 and the image decoding apparatus 700, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 600 of the sixth embodiment and the image 
decoding apparatus 700 of the seventh embodiment is realized by 
replacing the image coding unit 200a and the image decoding unit 
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300a in the document filing apparatus shown in figure 41(b) with 
the image coding apparatus 600 and the image decoding apparatus 
700, respectively. 
(Embodiment 8) 

Figure 8 is a block diagram illustrating the structure of an 
image coding apparatus according to an eighth embodiment of the 
present invention. This eighth embodiment corresponds to Claim 8. 

An image coding apparatus 800 according to this eighth 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

To be specific, the image coding apparatus 8 00 of this 
eighth embodiment includes a predictive image generation means 
801 which receives data indicating an image feature of a target 
image to be coded (image feature data Die), and generates data of 
a predictive image similar to the target image (predictive image 
data PDit) on the basis of the image feature data Die; and an 
entropy coding means 802 which receives data of the target image 
(target image data Dit) and the predictive image data PDit, 
subjects the target image data Dit to arithmetic coding with 
reference to the corresponding predictive image data PDit, and 
outputs entropy codes corresponding to the target image as coded 
data Die. 

Figure 32 is a schematic diagram for explaining the image 
feature . 
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It is assumed that an input image is a binary image 
comprising white pixels and black pixels. 

An image feature, by which a binary image similar to a 
target binary image can be reproduced, is used. For example, 
when the target binary image is a document image including 
characters as described in the above embodiments, a mesh feature 
described as follows can be used as an image feature. Further, 
character code or a feature vector for character recognition may 
be employed as an image feature. 

Hereinafter, an image feature employed in this eighth 
embodiment will be described. 

A target binary image 3200 is divided into regions of the 
same size (e.g., blocks each comprising 8X8 pixels). Then, the 
pixel values of pixels in each block are replaced with a pixel 
value of the highest frequency among the pixel values of the 
pixels in the block. In the case of a binary image, the pixel 
values in each block are replaced with the pixel value of either 
the black pixels or the white pixels which are larger in number 
in the block. 

As the result, the image feature of the inputted binary 
image (e.g., 64X64 pixels) becomes a reduced binary image 3202 
comprising 8X8 pixels. Hereinafter, this feature is called a 
mesh feature. 

Next, the operation will be described. 

When the target image data Dit and the image feature data 



108 



Die are input to the image coding apparatus 800, the predictive 
image generation means 801 generates a predictive image 
corresponding to the target image on the basis of the image 
feature data indicating the reduced binary image 3202 shown in 
figure 32, and outputs its data (predictive image data) PDit . 

The predictive image is generated by enlarging the reduced 
binary image. 

Figure 33 is a schematic diagram for explaining the method 
of enlarging the reduced binary image. 

For example, a block comprising 8X8 pixels is generated 
correspondingly to each of plural pixels 3301a in the reduced 
binary image 3301 so that each pixel in each generated block has 
the same pixel value as the corresponding pixel. 

To be specific, in the enlarging process, a pixel 3301al at 
the upper left corner of the reduced binary image 3301 is 
converted to an 8X8 pixel block 3302al at the upper left corner 
of the predictive image 3302. 

In the entropy coding means 802, arithmetic coding is 
performed on the target image data Dit with reference to the 
predictive image data PDit in like manner as described for the 
entropy coding means 106 according to the first embodiment. 

As described above, according to the eighth embodiment, the 
data of the predictive image (predictive image data PDit) 
corresponding to the target image is generated on the basis of 
the data indicating the image feature (image feature data Die) 
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which has previously been extracted from the target image to be 
coded, and the target image data Dit is subjected to arithmetic 
coding on the basis of the predictive image data PDit. Therefore, 
the coding efficiency in the entropy encoder is improved. 

Further, since the image feature data corresponding to the 
target image is output together with the entropy codes (coded 
data) corresponding to the target image data Dit, the coded data 
of the target image can be retrieved according to the image 
feature data. 
(Embodiment 9) 

Figure 9 is a block diagram illustrating the structure of an 
image coding apparatus according to a ninth embodiment of the 
present invention. This ninth embodiment corresponds to Claims 9, 
10, and 13. 

An image coding apparatus 900 according to this ninth 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

The image coding apparatus 900 of this ninth embodiment 
includes an image feature extraction means 901 which extracts 
image feature data Die from target image data Dit, in addition to 
the constituents of the image coding apparatus 800 according to 
the eighth embodiment. The image coding apparatus 900 performs 
arithmetic coding on the target image data Dit with reference to 
predictive image data PDit obtained from the corresponding image 
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feature data Die. That is, a predictive image generation means 
904 and an entropy coding means 905 constituting the image coding 
apparatus 900 are identical to the predictive image generation 
means 8 01 and the entropy coding means 802 of the image coding 
apparatus 800 according to the eighth embodiment. 

The image feature extraction means 901 is constructed so as 
to extract a mesh feature as an image feature from a target image 
to be coded, and the means 901 comprises a blocking means 902 
which divides the target image into plural blocks (image spaces 
each comprising 8X8 pixels) and outputs block data BDit 
corresponding to each block; and a block smoothing means 903 
which smoothes the pixel values of pixels in each block (pixels 
constituting each block) . To be specific, this block smoothing 
means 903 replaces the pixel values of pixels in each block with 
a pixel value of the highest occurrence frequency in the block. 
For example, in a binary image represented by black pixels and 
white pixels, a pixel value of the highest occurrence frequency 
is the pixel value of either the block pixels or the white pixels 
in the block which are larger in number in the block. 
Next, the operation will be described. 

It is assumed that target image data inputted to the image 
coding apparatus 900 of this ninth embodiment is data of a binary 
image . 

When the target image data Dit is input to the image coding 
apparatus 900, the image feature extraction means 901 extracts 
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image feature data Die from the target image data Dit. 

That is, in the blocking means 902 of the image feature 
extraction means 901, a binary image as a target image is divided 
into plural blocks of the same size (8X8 pixels), and image data 
BDit corresponding to each block is output. Next, in the block 
smoothing means 903, the block image data BDit is subjected to 
smoothing by which the pixel value of each pixel in the block is 
replaced with the pixel value of the highest occurrence frequency, 
and the block image data so smoothed is output as image feature 
data Die. 

Since the target image is a binary image, the pixel values 
of pixels in each block are replaced with either the pixel value 
of the black pixels or the pixel value of the white pixels which 
are larger in number in the block. 

As the result of the smoothing process, a reduced binary 
image comprising 8X8 pixels is obtained as an image feature 
(mesh feature) corresponding to the target binary image when the 
target binary image comprises 64X64 pixels. 

In the predictive image generation means 904, predictive 
image data PDit for the target image is generated on the basis of 
the image feature data Die. In the entropy coding means 905, the 
target image data Dit is subjected to arithmetic coding with 
reference to the predictive image data PDit, and entropy codes 
are output as coded data Die corresponding to the target image 
data . 
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As described above, the image coding apparatus 900 of this 
ninth embodiment is provided with, in addition to the 
constituents of the eighth embodiment, the image feature 
extraction means 901 for extracting the data Die indicating the 
image feature of the target image from the target image data Dit. 
Therefore, in addition to the effects of the eighth embodiment, 
the image feature data is extracted from the target image data in 
the image coding apparatus, resulting in an image coding 
apparatus suitable for use as an image coding means in a document 
filing apparatus or in a facsimile. 

Further, the image data of the target image is divided such 
that the target image is divided into plural blocks of the same 
size, and the image data corresponding to each block is replaced 
with the pixel value of the highest occurrence frequency among 
the pixel values of the pixels in the block, whereby image data 
corresponding to a reduced image which comprises the most- 
frequent pixel values of the respective blocks is output as image 
feature data of the target image. Therefore, the image feature 
data indicating the feature of the target image can be easily 
created. 
(Embodiment 10) 

Figure 10 is a block diagram illustrating the structure of 
an image decoding apparatus according to a tenth embodiment of 
the present invention. This tenth embodiment corresponds to 
Claims 12 and 14. 
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An image decoding apparatus 1000 of this tenth embodiment is 
adaptable to the image coding apparatus 800 or 900 according to 
the eighth or ninth embodiment, and it is used as an image 
decoding means in an electronic device having a scanner, such as 
the document filing apparatus 3900 shown in figure 39 or a 
facsimile . 

That is, this image decoding apparatus 1000 receives entropy- 
codes (coded data) Die and image feature data Die which are 
output from the image coding apparatus 800 or 900 according to 
the eighth or ninth embodiment, ad subjects the coded data Die to 
arithmetic decoding with reference to predictive image data PDit 
generated on the based of the image feature data Die. 

To be specific, the image decoding apparatus 1000 includes 
a predictive image generation means 1001 which generates 
predictive image data PDit on the basis of the image feature data 
Die; and an entropy decoding means 1002 which subjects the coded 
data Die to arithmetic decoding with reference to the predictive 
image data PDit, and outputs decoded image data Did corresponding 
to the target image . 

Also in this tenth embodiment, a reduced image (mesh 
feature) as described for the eighth embodiment is employed, and 
the target image is a binary image. Further, the inputted coded 
data Die is entropy codes obtained by arithmetic coding utilizing 
the correlation between the target image and the predictive image 
in the image coding apparatus according to the eighth or ninth 
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embodiment . 

Next, the operation will be described. 

When the coded data Die and the image feature data Die are 
input to the image decoding apparatus 1000, the predictive image 
generation means 1001 generates data PDit of a predictive image 
corresponding to the target image on the basis of the image 
feature data Die . 

In the entropy decoding means 1002, the coded data Die of 
the target image is subjected to arithmetic decoding with 
reference to the predictive image data PDit, and decoded image 
data Did of the target image is output. 

As described above, the image decoding apparatus 1000 of 
this tenth embodiment is provided with the predictive image 
generation means 1001 which generates predictive image data PDit 
corresponding to the target image on the basis of the image 
feature data Die of the target image, and performs arithmetic 
decoding on the coded data Die with reference to the predictive 
image data PDit. Therefore, it is possible to realize an image 
decoding apparatus which can correctly decode the entropy codes 
obtained by efficient arithmetic coding utilizing the correlation 
between the target image and the predictive image. 

Further, a facsimile provided with the image coding 
apparatus 900 of the ninth embodiment and the image decoding 
apparatus 1000 of the tenth embodiment is realized by replacing 
the image coding unit 200a and the image decoding unit 300a in 
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the facsimile shown in figure 41(a) with the image coding 
apparatus 900 and the image decoding apparatus 1000, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 900 of the ninth embodiment and the image 
decoding apparatus 1000 of the tenth embodiment is realized by 
replacing the image coding unit 2 00a and the image decoding unit 
300a in the document filing apparatus shown in figure 41(b) with 
the image coding apparatus 900 and the image decoding apparatus 
1000, respectively. 
(Embodiment 11) 

Figure 11 is a block diagram illustrating the structure of 
an image coding apparatus according to an eleventh embodiment of 
the present invention. This eleventh embodiment corresponds to 
Claims 9, 11, and 15. 

An image coding apparatus 1100 according to this eleventh 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

The image coding apparatus 1100 of this eleventh embodiment 
includes an image feature extraction means 1101 which extracts, 
as image feature data Die, an identifier corresponding to an 
image similar to a target image, from target image data Dit, in 
addition to the constituents of the image coding apparatus 800 
according to the eighth embodiment. The image coding apparatus 
1100 subjects the target image data Dit to arithmetic coding with 
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reference to predictive image data PDit obtained by image feature 
data Die corresponding to the data Dit. That is, a predictive 
image generation means 1104 and an entropy coding means 1105 
constituting the image coding apparatus 1100 are identical to the 
predictive image generation means 801 and the entropy coding 
means 802 of the image coding apparatus 800 according to the 
eighth embodiment. 

The image feature extraction means 1101 includes a feature 
vector extraction means 1102 which extracts a feature vector 
indicating the feature of a target image to be coded, from the 
target image; and a vector quantization means which subjects the 
feature vector of the target image to vector quantization, and 
outputs an identifier of a similar image. The feature vector is 
a kind of a feature utilized in character pattern recognition or 
the like. Although any feature vector may be employed as long as 
it can be used for character recognition, especially a background 
feature or a peripheral feature are effective (refer to "Pattern 
Recognition", The Institute of Electronics, Information and 
Communication Engineers, p. 43). 

For example, as a feature vector corresponding to a binary 
image showing a hiragana character "$>", there is a vector having 
an array of "0" and "1" which is obtained by scanning the 
respective pixels in the reduced image 3202 of the character 
image 32 00 shown in figure 32, in a predetermined order, 

with the white pixels being "0" and the black pixels being "1". 
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In the vector quantization process, the above-mentioned 
identifier is derived using a VQ code book on the basis of the 
feature vector. In the VQ code book, each representative feature 
vector is associated with an identifier. The representative 
feature vector is a vector which is set on each of plural groups 
obtained by clustering plural learning vectors defined in a 
vector space . 

When an arbitrary vector is input to the vector quantization 
means 1103, a group providing the shortest distance between its 
representative feature vector and the arbitrary vector in the 
vector space is found, and an identifier associated with the 
representative feature vector of this group is output on the 
basis of the VQ code book. A VQ code book formation method is 
described in "Linde, Buzo, Gray; An Algorithm for Vector 
Quantizer Design, IEEE Trans. Commun., COM-28-1, pp. 84-95, 1980". 

In this eleventh embodiment, a feature vector obtained from 
an image is considered. A feature vector obtained from a 
character font (binary character image) is used as a learning 
vector, and an Euclidean distance is used as a distance between 
vectors. The VQ code book is composed of sets of representative 
feature vectors of plural groups and identifiers. 

A predictive image generation means 1104 and an entropy 
coding means 1105 constituting the image coding apparatus 1100 
are identical to the predictive image generation means 801 and 
the entropy coding means 802 of the image coding apparatus 800 
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according to the eighth embodiment. 

Next, the operation will be described. 

It is assumed that target image data to be input to the 
image coding apparatus 110 0 of this eleventh embodiment is data 
of a binary image. 

When the target image data Dit is input to the image coding 
apparatus 1100, the image feature extraction means 1101 extracts 
image feature data Die from the target image data Dit. 

That is, the feature vector extraction means 1102 in the 
image feature extraction means 1101 extracts a feature vector Vc 
from the input image, as a feature to be used for character 
recognition or the like. Then, the vector quantization means 
1103 finds a representative feature vector closest to the 
obtained feature vector Vc, and outputs an identifier Die 
associated with this representative feature vector. 

In the predictive image generation means 1104, predictive 
image data PDit is obtained on the basis of the identifier (image 
feature data) Die outputted from the vector quantization means 
1103. The predictive image is an image representing the group in 
the vector space which is associated with the identifier Die, and 
it is a character image having a feature vector closest to the 
representative feature vector of this group. The predictive 
image may be one obtained by averaging character images 
corresponding to plural feature vectors included in the 
respective groups in the vector image space. 
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Finally, in the entropy coding means 1105, as in the ninth 
embodiment, arithmetic coding utilizing the correlation between 
the predictive image and the target image is carried out on the 
basis of the predictive image data outputted from the predictive 
image generation means 1104. 

As described above, the image coding apparatus 1100 of this 
eleventh embodiment is provided with the image feature extraction 
means 1101 which extracts an identifier corresponding to an image 
similar to a target image, as an image feature, from the target 
image. The image coding apparatus 1100 obtains the similar image 
as a predictive image of the target image, on the basis of the 
identifier, and subjects data of the target image to arithmetic 
coding with reference to the similar image. Therefore, the 
coding efficiency of the arithmetic encoder is improved, and 
coded data De of the target image can be retrieved by using the 
identifier. 

Further, feature vectors Vc corresponding to the respective 
character images included in the target image (document image) 
are quantized, and predictive images corresponding to the 
respective character images are generated on the basis of the 
representative feature vectors corresponding to these feature 
vector Vc. Therefore, one representative feature vector is 
output as data of each character in the document image, whereby 
the character data of the document image is prevented from being 
redundant and, further, adverse effect of errors in character 
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recognition (variations in feature extraction) is reduced when 
performing retrieval of the document image using the character 
data. 

(Embodiment 12) 

Figure 12 is a block diagram illustrating the structure of 
an image decoding apparatus according to a twelfth embodiment of 
the present invention. This twelfth embodiment corresponds to 
Claim 16. 

An image decoding apparatus 1200 of this twelfth embodiment 
is adaptable to the image coding apparatus 1100 according to the 
eleventh embodiment, and it is used as an image decoding means in 
an electronic device having a scanner, such as the document 
filing apparatus 3900 shown in figure 39 or a facsimile. 

That is, this image decoding apparatus 1200 receives entropy 
codes (coded data) Die and image feature data (predictive image 
identifier) Die which are output from the image coding apparatus 
1100 according to the eleventh embodiment, ad subjects the coded 
data Die to arithmetic decoding with reference to predictive 
image data PDit generated on the based of the image feature data 
Die . 

To be specific, the image decoding apparatus 1200 includes 
a predictive image generation means 12 01 which generates 
predictive image data PDit on the basis of the image feature data 
Die; and an entropy decoding means 1202 which subjects the coded 
data Die to arithmetic decoding with reference to the predictive 
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image data PDit, and outputs decoded image data Did corresponding 
to the target image . 

The image feature is an identifier indicating a similar 
image as described in the eleventh embodiment, and the target 
image is a binary image. The coded data Die to be input is 
entropy codes obtained by arithmetic coding utilizing the 
correlation between the target image and the predictive image 
(similar image) in the image coding apparatus according to the 
eleventh embodiment . 

It is now assumed that the above-mentioned identifier 
corresponds to a representative feature vector obtained by 
performing vector quantization on the above-mentioned feature 
vector. 

Next, the operation will be described. 

When the coded data Die and the image feature data 
(predictive image identifier) Die are input to the image decoding 
apparatus 1200 of this twelfth embodiment, the predictive image 
generation means 120 generates data of an image similar to the 
target image (predictive image data) PDit on the basis of the 
predictive image identifier Die. 

In the entropy decoding means 1202, the coded data Die 
corresponding to the target image is subjected to arithmetic 
decoding with reference to the predictive image data PDit, and 
decoded image data Did corresponding to the target image is 
output . 
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As described above, the image decoding apparatus 1200 of 
this twelfth embodiment is provided with the predictive image 
generation means 1201 which generates the data PDit of the 
similar image similar to the target image on the basis of the 
image feature data (predictive image identifier) Die 
corresponding to the target image, and the coded data Die is 
subjected to arithmetic decoding with reference to the predictive 
image data PDit. Therefore, it is possible to realize an image 
decoding apparatus which can correctly decode the entropy codes 
obtained by efficient entropy coding utilizing the correlation 
between the target image and the predictive image. 

Further, a facsimile provided with the image coding 
apparatus 1100 of the eleventh embodiment and the image decoding 
apparatus 12 00 of the twelfth embodiment is realized by replacing 
the image coding unit 200a and the image decoding unit 300a in 
the facsimile shown in figure 41(a) with the image coding 
apparatus 1100 and the image decoding apparatus 1200, 
respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 1100 of the eleventh embodiment and the 
image decoding apparatus 1200 of the twelfth embodiment is 
realized by replacing the image coding unit 200a and the image 
decoding unit 300a in the document filing apparatus shown in 
figure 41(b) with the image coding apparatus 1100 and the image 
decoding apparatus 1200, respectively. 
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(Embodiment 13) 

Figure 13 is a block diagram illustrating the structure of 
an image coding apparatus according to a thirteenth embodiment of 
the present invention. This thirteenth embodiment corresponds to 
Claim 17. 

An image coding apparatus 1300 according to this thirteenth 
embodiment is used as, for example, an image coding means in the 
document filing apparatus 3900 shown in figure 39. 

To be specific, the image coding apparatus 1300 includes an 
entropy coding means 1301 which receives data of a target image 
to be coded (target image data) Dit and data of a predictive 
image similar to the target image (predictive image data) PDic, 
and subjects the target image data Dit to arithmetic coding with 
reference to the corresponding predictive image data PDit to 
output entropy codes corresponding to the target image as its 
coded data Die . 

Next, the function and effect will be described. 

When the target image data Dit and the predictive image data 
PDit are input to the image coding apparatus 1300, the entropy 
coding means 1302 performs arithmetic coding on the target image 
data Dit with reference to the predictive image data PDit, in the 
same manner as described for the entropy coding means 10 6 of the 
first embodiment. 

As described above, the image coding apparatus 1300 of this 
thirteenth embodiment is provided with the entropy coding means 
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1301 which performs arithmetic coding on the target image data 
Dit with reference to the corresponding predictive image data 
PDit. Therefore, when performing coding on the target image data 
Dit, the coding efficiency of the arithmetic encoder can be 
improved by specifying an image similar to the target image and 
inputting its data PDit as predictive image data corresponding to 
the target image . 
(Embodiment 14) 

Figure 14 is a block diagram illustrating the structure of 
an image coding apparatus according to a fourteenth embodiment of 
the present invention. This fourteenth embodiment corresponds to 
Claims 18 and 19. 

An image coding apparatus 1400 according to this fourteenth 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

The image coding apparatus 1400 includes an image prediction 
means 1401 for generating predictive image data PDic 
corresponding to target image data Dit from the target image data 
Dit, instead of the image feature extraction means 1101 and the 
predictive image generation means 1104 of the image coding 
apparatus 1100 according to the eleventh embodiment, and the 
image coding apparatus 14 00 performs arithmetic coding on the 
target image data Dit with reference to the predictive image data 
PDit. That is, an entropy coding means 1405 included in the 
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image coding apparatus 1400 is identical to the entropy coding 
means 1105 of the image coding apparatus 1100 according to the 
eleventh embodiment . 

In this fourteenth embodiment, the image prediction means 
1401 comprises a feature extraction means 1402 which extracts a 
feature vector Vc indicating the feature of a target image to be 
coded from the target image; a vector quantization means 1403 
which performs vector quantization on the feature vector of the 
target image to output an identifier Die of a similar image; and 
a predictive image generation means 1404 which generates 
predictive image data PDit corresponding to the target image on 
the basis of the identifier. 

In this fourteenth embodiment, vector quantization is 
employed as a method for extracting predictive image data, and 
the feature extraction means 1402, the vector quantization means 
1403, and the predictive image generation means 1404 are 
identical to the feature extraction means 1101, the vector 
quantization means 1103, and the predictive image generation 
means 1104 according to the eleventh embodiment, respectively. 

Next, the operation will be described. 

When the target image data Dit is input to the image coding 
apparatus 1400, the image prediction means 1401 generates 
predictive image data PDit from the target image data Dit. That 
is, in the image prediction means 1401, the predictive image data 
is generated by the feature extraction means 1402, the vector 
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quantization means 1403, and the predictive image generation 
means 1404 which perform the same processes as described for the 
corresponding means 1101, 1103, and 1104 according to the 
eleventh embodiment. 

In the entropy coding means 1405, the target image data Dit 
is subjected to entropy coding utilizing the correlation between 
the predictive image data PDit and the target image data Dit, in 
the same manner as described for the entropy coding means 1105 
according to the eleventh embodiment. 

As described above, the image coding apparatus 1400 of this 
fourteenth embodiment is provided with the image prediction means 
1401 which generates the predictive image data PDic corresponding 
to the target image data Dit, and the target image Dit is 
subjected to entropy coding with reference to the predictive 
image data PDit. Therefore, the coding efficiency of the 
arithmetic encoder is improved and, furthermore, coded data De of 
the target image can be retrieved using the predictive image data 
PDit. 

{Embodiment 15) 

Figure 15 is a block diagram illustrating the structure of 
an image decoding apparatus according to a fifteenth embodiment 
of the present invention. This fifteenth embodiment corresponds 
to Claim 20. 

An image decoding apparatus 1500 according to this fifteenth 
embodiment is adapted to the image coding apparatus 14 00 of the 
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fourteenth embodiment, and it is used as an image decoding means 
in an electronic device having a scanner, such as the document 
filing apparatus 3900 shown in figure 39 or a facsimile. 

That is, the image decoding apparatus 1500 receives the 
entropy codes (decoded data) Die and the predictive image data 
PDit which are output from the image coding apparatus 1400 of the 
fourteenth embodiment, and performs arithmetic decoding on the 
coded data Die with reference to the predictive image data PDit. 

Next, the operation will be described. 

When the coded data Die and the predictive image data PDic 
are input to the image decoding apparatus 1500, the entropy 
decoding means 1501 performs arithmetic coding on the coded data 
Die of the target image with reference to the predictive image ' 
data PDit to output decoded image data Did of the target image. 

As described above, in the image decoding apparatus 1500 of 
the fifteenth embodiment, since the coded data Die of the target 
image is subjected to entropy decoding with reference to the 
predictive image data PDit corresponding to the target image, it 
is possible to realize an image decoding apparatus which can 
correctly decode entropy codes obtained by efficient entropy 
coding utilizing the correlation between the target image and the 
predictive image. 

A facsimile provided with the image coding apparatus 1300 or 
1400 of the thirteenth or fourteenth embodiment and the image 
decoding apparatus 1500 of the fifteenth embodiment is realized 
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by replacing the image coding unit 200a and the image decoding 
unit 300a in the facsimile shown in figure 41(a) with the image 
coding apparatus 1300 or 1400 and the image decoding apparatus 
1500, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 1300 or 1400 of the thirteenth or 
fourteenth embodiment and the image decoding apparatus 1500 of 
the fifteenth embodiment is realized by replacing the image 
coding unit 200a and the image decoding unit 300a in the document 
filing apparatus shown in figure 41{b) with the image coding 
apparatus 1300 or 1400 and the image decoding apparatus 1500, 
respectively. 
(Embodiment 16) 

Figure 16 is a block diagram illustrating the structure of 
an image coding apparatus according to a sixteenth embodiment of 
the present invention. This sixteenth embodiment corresponds to 
Claim 33. 

An image coding apparatus 1600 of this sixteenth embodiment 
is used as an image coding means in an electronic device having a 
scanner, such as the document filing apparatus 3900 shown in 
figure 39 or a facsimile. 

The image coding apparatus 1600 includes an image coding 
means 1601 which encodes target image data Dit to output coded 
data Die; and an attribute information addition means 1602 which 
receives attribute information Dai relating to the target image 
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as well as coded data Die of the target image, adds the attribute 
information Dai to the coded data Die, and outputs attribute- 
added coded data Daie. 

The image coding means 1601 is identical in structure to the 
image coding apparatus 900 of the ninth embodiment. However, the 
structure of the image coding means 1601 is not restricted to 
that of the image coding apparatus 900 of the ninth embodiment. 
The image coding means 1601 may be constituted by any of the 
image coding apparatuses according to the eighth, eleventh, 
thirteenth, and fourteenth embodiments. Although a document 
image including characters or a character image showing a 
character itself may be employed as a target image, in this 
sixteenth embodiment the target image is a character image, and' 
the attribute information indicates the attribute relating to the 
character image. Accordingly, the image coding means 1601 
outputs, as coded data Die, a character image code corresponding 
to the character image. 

Figure 34 is a schematic diagram for explaining the 
attribute information relating to the character image. 

The attribute information includes plural attribute items as 
follows: the position where the target character image to be 
coded has been placed in the document image; the height and width 
of the character image area in the document image; and the 
orientation (i.e., either top-to-bottom or left-to-right) of the 
character image areas in the document image. The position of the 
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character image in the document image is represented by the 
coordinates of an upper-left apex of a rectangle circumscribing 
the character image (the upper-left coordinates of the 
circumscribing rectangle) . The height of the character image 
area is the dimension of the character image in the vertical 
direction . 

As shown in figure 34, each of the respective attribute 
items included in the attribute information is described by a set 
of an identifier A(i) [i=0 , 1, 2 , . . . , n] for identifying the 
attribute item (attribute identifier) and an attribute value M(i) 
[i=0, 1, 2, . . . , n] indicating the attribute item in quantity 
(usually, vectors) , and the end of one attribute information in a 
code sequence is indicated by a special attribute identifier 
called EOT (End of Table) . 

For example, an attribute identifier A(0) shows the upper- 
left coordinates of the circumscribing rectangle as an attribute 
item and has a value "0", and an attribute value M(0) shows the 
value of the upper-left coordinates of the circumscribing 
rectangle. An attribute identifier A(l) shows the height of the 
character image area as an attribute item and has a value "1", 
and an attribute value M(l) is a numerical value of the height of 
the character image area. An attribute identifier A (2) shows the 
width of the character image area as an attribute item and has a 
value "2", and an attribute value M(2) is a numerical value of 
the width of the character image area. An attribute identifier 
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A(3) indicates the orientation, i.e., either top-to-bottom (0) or 
left-to-right (1), of the character images as an attribute item, 
and has a value "3", and an attribute value M(3) is either a 
numerical value "0" indicating the top-to-bottom orientation (0) 
or a numerical value "1" indicating the left-to-right orientation 

(1) . Further, an attribute identifier A(i-l) shows the i-th 
attribute item and has a predetermined value "i-1", and an 
attribute value M(i-l) is a predetermined numerical value 
indicating the i-th attribute item Furthermore, an attribute 
identifier A(n) shows that there is no attribute item following 
the n-th attribute item, and has a symbol "EOT". 

Figure 35 (a) shows a code sequence in attribute-added coded 
data Daie in the case where attribute information of a character 
image has three attribute items as follows: the coordinates 

(104,23) of the circumscribing rectangle, the width (53) of the 
character image area, and the top-to-bottom orientation (0) . 

In this attribute-added coded data Daie, the attribute 
information Dai is placed before the coded data Die of the 
character image, and the code sequence corresponding to this 
attribute information Dai includes a pair of an attribute 
identifier A(0) having a value "0" and an attribute value M(0) 
having a value (104,23), a pair of an attribute identifier A(2) 
having a value "2" and an attribute value M(2) having a value 

(53), and a pair of an attribute identifier A (3) having a value 
"3" and an attribute value M(3) having a value (0) . After the 
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attribute value M(3), an attribute identifier A(n) having a 
symbol "EOT" is placed. 

Next, the operation will be described. 

When data Dit of a target image (character image) is input 
to the image coding apparatus 1600 of this sixteenth embodiment, 
the image coding means 1601 subjects the target image data Dit to 
entropy coding with reference to predictive image data PDit, like 
the image coding apparatus 900 of the ninth embodiment, and 
outputs coded data (character image code) Die as well as image 
feature data Die. 

At this time, the attribute information addition means 1602 
receives the character image code Die, and attribute information 
Dai of the target image (input character image) from the outside. 
Then, the attribute information addition means 1602 adds the 
attribute information Dai to the character image code Die, and 
outputs attribute- added coded data Daie. 

As described above, the image coding apparatus 1600 of this 
sixteenth embodiment is provided with a coding means of the same 
structure as that of the image coding apparatus 900 of the ninth 
embodiment as the image coding means 1601 for coding the 
character image data and outputting the coded data (character 
image code) Die, and the attribute information Dai is added to 
the character image code Die to be output from the image coding 
means 1601. Therefore, in addition to the effects of the ninth 
embodiment, the attribute of the character image is obtained 
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without decoding the character image code. 

Further, when performing retrieval of the character image 
using the image feature data, narrower-scope retrieval can be 
performed with reference to the attribute information of the 
character image . 
(Embodiment 17) 

Figure 17 is a block diagram illustrating the structure of 
an image coding apparatus according to a seventeenth embodiment 
of the present invention. This seventeenth embodiment 
corresponds to Claim 34 . 

An image coding apparatus 17 00 of this seventeenth 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

The image coding apparatus 1700 includes a character image 
coding means 1701 which receives data Dit of a target image, 
encodes image data of a character image included in the target 
image, and outputs coded data (character image code) Del of the 
character image and positional data Dcp indicating the position 
of the character image in the target image; a character image 
deletion means 1702 which receives the target image data Dit and 
the positional data Dcp of the character image, and outputs data 
Dcd of a non-character image obtained by deleting the character 
image from the target image; and a non-character image coding 
means 1703 which encodes the non-character image data Dcd, and 
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outputs coded data (non-character image code) De2 of the non- 
character image. 

The character image coding means 1701 includes, as its part, 
the image coding apparatus according to the sixteenth embodiment 
which encodes the character image data on the basis of the 
character image data and its attribute information to output 
attribute-added coded data Daie including the attribute 
information Dai of the character image and the character image 
code Die. 

Next, the operation will be described. 

When data of a binary document image is input as target 
image data Dit to the image coding apparatus 1700 of this 
seventeenth embodiment, the character image coding means 1701 
extracts, as a character image, an image of each character part 
of the target image, encodes the data of each character image, 
and outputs a character image code Del as coded data of each 
character image. At this time, attribute information (not shown) 
of the character image is output together with the character 
image code Del . 

Next, in the character image deletion means 1702, each 
character part (character image) is extracted from the target 
image (document image) . Thereafter, the pixel values of pixels 
constituting the character-deleted part of the target image are 
interpolated by the pixel values of pixels positioned in the 
vicinity of the character-deleted part. When the target image is 



135 



a binary image, the character-deleted part is filled with white 
pixels. Thereby, non-character image data Dcd (i.e., data 
corresponding to the image where the pixel values of pixels 
constituting the character part of the target image is replaced 
with the pixel values of the peripheral pixels) is output from 
the character image deletion means 1702. 

Finally, in the non-character image coding means 1703, the 
non-character image data Dcd is encoded by a compressive coding 
method such as JBIG (Joint Bi-Level Image Coding Experts Group) , 
MMR (Modified Modified Read) , or JPEG (Joint Photographic Coding 
Experts Group) , whereby coded data of the non-character image is 
output as a non-character image code De2 . 

Hereinafter, the coding process performed by the image 
coding apparatus 1700 will be described more specifically. 

Figure 36 is a diagram for explaining the process performed 
by the image coding apparatus 1700. 

For example, when the image coding apparatus 17 00 receives a 
binary document image 3601 as an image of a document using a 
table, and attribute information indicating the positions and 
sizes of character images included in the document image, the 
character image coding means 1701 extracts data of the respective 
character images 3603 in the document image, and encodes the 
extracted data for each character image. Thereafter, the 
character image coding means 1701 successively outputs the coded 
data corresponding to each character image, as a character image 
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code Del. 

In the character image deletion means 1702, the part of the 
document image corresponding to each character image is filled 
with white pixels (pixel replacement process) on the basis of the 
attribute information indicating the position and size of each 
character image included in the document image , and data Dcd of 
the non-character image 3 602, i.e., the document image from which 
the character parts are deleted, is output. 

Then, in the non-character image coding means 1703, the data 
Dcd of the non-character image 3 602 is encoded by a compressive 
coding method such as JBIG, MMR, or JPEG, and the coded data of 
the non-character image is output as a non-character image code 
De2 . 

As described above, the image coding apparatus 1700 of this 
seventeenth embodiment is provided with the character image 
coding means 1701 which receives the data Dit of the document 
image, extracts each character image from the document image, and 
encodes the data of the extracted character image; and the 
character image deletion means 1702 which receives the document 
image data Dit, and deletes the character parts from the document 
image to generate data of the non-character image. Thereby, when 
coding the data of the document image, the character image and 
the non-character image are coded separately. Therefore, the 
character image and the non-character image can be coded by 
different coding methods having high efficiencies and suited to 
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the respective images. Further, document retrieval can be 
performed utilizing the coded data (character image code) 
corresponding to each character image. 
(Embodiment 18) 

Figure 18 is a block diagram illustrating the structure of 
an image decoding apparatus according to an eighteenth embodiment 
of the present invention. This eighteenth embodiment corresponds 
to Claim 35. 

An image decoding apparatus 1800 according to this 
eighteenth embodiment is adapted to the image coding apparatus 
1700 according to the seventeenth embodiment, and it is used as, 
for example, an image decoding means in an electronic device 
having a scanner, such as the document filing apparatus 3900 
shown in figure 39 or a facsimile. 

The image decoding apparatus 1800 includes a character image 
decoding means 1801 which receives sequentially-inputted 
character image codes Del, and decodes the respective character 
image codes Del to generate character image data Ddl; a non- 
character image decoding means 1802 which receives a non- 
character image code De2, and decodes it to generate non- 
character image data Dd2; and an image reconstruction means 1803 
which receives the non-character image data and the character 
image data, and reconstructs a document image on the basis of 
attribute information (not shown) of the document image such that 
each character image is placed in a predetermined position on the 
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non-character image, thereby generating data Dd of the document 
image as a target image. 

Next, the operation will be described. 

When the character image codes Del and the non-character 
image code De2 are input to the image decoding apparatus 1800, 
the character image decoding means 1801 subjects the character 
image codes Del to a decoding process adapted to the character 
image coding process performed by the image coding apparatus 1700, 
thereby generating character image data Ddl . At this time, the 
non-character image decoding means 1802 subjects the non- 
character image code De2 to a decoding process adapted to the 
non-character image coding process performed by the image coding 
apparatus 1700, thereby generating non-character image data Dd2'. 

Thereafter, the image reconstruction means 1803 reconstructs 
a document image on the basis of the attribute information (not 
shown) of the document image by using the non-character image 
data and the character image data, thereby generating data Dd of 
the document image wherein the respective character images are 
placed in predetermined positions on the non-character image. 

As described above, in the image decoding apparatus 18 00 of 
this eighteenth embodiment, the coded data Del of the respective 
character images in the document image and the coded data De2 of 
the non-character image obtained by deleting the character images 
from the document image are received separately as coded data 
corresponding to the document image, and the respective coded 
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data are decoded separately to generate the character image data 
Ddl and the non-character image data Dd2 and, thereafter, the 
document image is reconstructed on the basis of these data Ddl 
and Dd2 to generate document image data. Therefore, it is 
possible to realize an image decoding apparatus which can 
correctly decode the coded data Del and De2 which have been 
obtained by efficient coding methods suited to the character 
images and the non-character image, respectively. 

Further, the document image can be retrieved by using the 
coded data (character image codes) corresponding to the character 
images . 

A facsimile provided with the image coding apparatus 1600 or 
17 00 of the sixteenth or seventeenth embodiment and the image 
decoding apparatus 1800 of the eighteenth embodiment is realized 
by replacing the image coding unit 200a and the image decoding 
unit 300a in the facsimile shown in figure 41(a) with the image 
coding apparatus 1600 or 1700 and the image decoding apparatus 
1800, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 1600 or 1700 of the sixteenth or 
seventeenth embodiment and the image decoding apparatus 1800 of 
the eighteenth embodiment is realized by replacing the image 
coding unit 200a and the image decoding unit 300a in the document 
filing apparatus shown in figure 41(b) with the image coding 
apparatus 1600 or 1700 and the image decoding apparatus 1800, 
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respectively . 
(Embodiment 19) 

Figure 19 is a block diagram illustrating the structure of a 
character collation apparatus according to a nineteenth 
embodiment of the present invention. This nineteenth embodiment 
corresponds to Claim 36. 

The character collation apparatus 1900 of this nineteenth 
embodiment is used as a component of an information retrieval 
apparatus employed in an electronic device such as the document 
filing apparatus 3900 shown in figure 39. 

The character collation apparatus 1900 includes a character 
attribute collation means 1901 which receives a character image 
code D19 to which attribute information Dai is added, and outputs 
data Sr indicating the result of collation as to whether the 
character image code D19 satisfies a retrieval condition supplied 
from the outside, on the basis of data Sd of the retrieval 
condition. 

The character image code D19 to which the attribute 
information Dai is added is identical in data structure to the 
attribute-added coded data Daie outputted from the image coding 
apparatus 1600 of the sixteenth embodiment. 

This attribute information includes attribute identifiers 
A(i) and attribute values M(i) corresponding to various kinds of 
attributes, and it comprises a set of plural pairs of attribute 
identifiers and attribute values (generally, vectors) 
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corresponding to the respective attribute items. 

Further, the retrieval condition data Sd includes plural 
conditions according to the respective attributes (attribute- 
based conditions) and each attribute-based condition is described 
by a pair of an attribute identifier and a conditional expression 
having a variable as its attribute value. When the attribute 
value of a specific attribute in the character image code D19 
satisfies the conditional expression of the attribute value of 
the corresponding attribute-based condition, this condition is 
regarded as "true". When the attribute value of the specific 
attribute does not satisfy the conditional expression of the 
attribute value of the corresponding attribute-based condition, 
this condition is regarded as "false". 

When all of the attribute-based conditions in the retrieval 
condition are "true", it is decided that the character image code 
to be retrieved satisfies the retrieval condition. 

For example, it is assumed that the character image code D19 
has attribute information as shown in figure 35(a). That is, the 
attribute value M(0) of the attribute (the upper-left coordinates 
of the circumscribing rectangle) shown by the attribute 
identifier A(0) is (104,23), the attribute value M(2) of the 
attribute (the width of the character image area) shown by the 
attribute identifier A(2) is 53, and the attribute value M(3) of 
the attribute (up-to-down or left-to-right) shown by the 
attribute identifier A(3) is 0 (up-to-down) . 
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Further, as shown in figure 35(b), the retrieval condition 
includes two attribute-based conditions 3501 and 3502. The 
attribute-based condition 3501 includes an attribute identifier 
sa(2) and a conditional expression SM(2) of an attribute value 
relating to an attribute (the width of the character image area) 
shown by the identifier, and the conditional expression SA(2) of 
the attribute value is X>30 which means that the width is larger 
than 30. The attribute-based condition 3502 includes an 
attribute identifier SA(3) and an attribute value SM(3) relating 
to an attribute (up-to-down or left-to-right) shown by the 
identifier, and the attribute value SM(3) is X==0 which means 
that the orientation is up-to-bottom. 

Since the character image code D19 having the attribute 
information Dai shown in figure 35(a) satisfies both of the two 
attribute-based conditions 3501 and 3502 in the retrieval 
condition 3500, the character image code D19 is decided as 
satisfying the retrieval condition 3500. 

Next, the operation will be described. 

When the character image code D19 and the data Sd indicating 
the retrieval condition 3500 are input to the character collation 
apparatus 1900, the character attribute collation means 1901 
decides whether or not the character image code D19 satisfies 
each of the attribute-based conditions in the retrieval condition 
3500. 

That is, since the retrieval condition 3500 includes the 
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attribute-based condition 3501 comprising the attribute 
identifier SA(2) and the attribute value SM(2), and the 
attribute-based condition 3502 comprising the attribute 
identifier SA(3) and the attribute value SM(3) as shown in figure 
35(b), the character image satisfying the retrieval condition 
should be one having a width of its area larger than 30 and being 
oriented up-to-down. 

On the other hand, since the character image code D19 has 
the attribute information including the attribute identifiers 
A(0), A(2) and A(3) and the attribute values M(0) , M(2) and M(3) 
as shown in figure 35(a), it is clear that this character image 
has the upper-left coordinates (104,23) of its circumscribing 
rectangle and the width (53) of its area, and is oriented up-to- 
down . 

So, the character attribute collation means 1901 decides 
that the character image corresponding to the character image 
code D19 satisfies both of the attribute-based conditions 3501 
and 3502 in the retrieval condition 3500, and the character 
collation apparatus 1900 outputs, for example, a large character 
included in the title line of the document image, and a character 
image code (coded data of a character image) corresponding to an 
up-to-down character line. 

As described above, the character collation apparatus 1900 
of this nineteenth embodiment is provided with the character 
collation means 1901 which collates the attribute information 
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attached to the character image code and the retrieval condition 
to decide whether the attribute information satisfies the 
retrieval condition. Therefore, even in the state where the 
character image data is coded, only a large character included in 
the title line of the document image or only a character line 
such as an up-to-down oriented line can be extracted. 
(Embodiment 20) 

Figure 20 is a block diagram illustrating the structure of a 
character collation apparatus according to a twentieth embodiment 
of the present invention. This twentieth embodiment corresponds 
to Claims 37 and 38. 

A character collation apparatus 2000 according to this 
twentieth embodiment is used as a component of an information 
retrieval apparatus employed in an electronic device such as the 
document filing apparatus 3900 shown in figure 39. 

This character collation apparatus 2000 receives a character 
code Deo specifying a character image supplied from the outside, 
collates a character image corresponding to a character image 
code D20 to which image feature data V20 is attached, with the 
character image specified by the character code, and outputs data 
Sr indicating the result of the collation. 

To be specific, the character collation apparatus 2000 
includes an image feature extraction means 2001 for extracting an 
image feature included in the character image specified by the 
character code. The image feature extraction means 2001 
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comprises a character image generation means 2002 which generates 
data Di of a character image specified by the character code Deo; 
and a feature extraction means 2003 which receives the character 
image data Di, extracts the image feature included in the 
character image specified by the character code, and outputs 
image feature data Vc. The image feature data V2 0 and the image 
feature data Vc are represented by vectors like the image feature 
data outputted from the character extraction means 1102 of the 
image coding apparatus 1100 according to the eleventh embodiment. 

The character collation apparatus 2000 further includes a 
distance calculation means 2005 which obtains a Euclidean 
distance between the image feature data V20 possessed by the 
character image code D20 and the image feature data Vc obtained' 
from the image feature extraction means 2001, and outputs 
distance information Cd; and a collation decision means 2006 
which outputs data Sr indicating the result of collation as to 
whether the character image corresponding to the character image 
code D20 matches the character image specified by the character 
code, on the basis of the distance information Cd. 

In this twentieth embodiment, the image feature included in 
the character image is a reduced image (mesh feature) 3202 as 
shown in figure 32, and the image feature data is a vector 
comprising plural values obtained by scanning the pixel values of 
the respective pixels (mesh) of the reduced image. 

Next, the operation will be described. 
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When the character image code D20 and the character code Deo 
are input to the character collation apparatus 2000 of the 
twentieth embodiment, the character image generation means 2002 
generates data Di of a character image specified by the character 
code Deo on the basis of character font information used in a 
computer or the like. 

When this character image data Di is input to the feature 
extraction means 2003, this means 2003 extracts the image feature 
of the character image, and generates data (vector) Vc indicating 
the image feature. The feature extraction means 2003 performs 
this process in the same manner as described for the feature 
extraction means 901 of the ninth embodiment. 

When the reduced image obtained as the image feature is 
composed of 8X8 pixels, the reduced image can be regarded as a 
vector (feature vector) in the sixty- four-dimensional Euclidean 
space . 

In the distance calculation means 2004, on the basis of the 
image feature data V20 attached to the character image code D20 
and the image feature data Vc outputted from the image feature 
extraction means 2 001, a Euclidean distance between the two 
feature vectors indicated by these data is obtained, and distance 
information Cd is output. 

In the collation decision means 2005, on the basis of the 
distance information Cd, it is decided that the character image 
corresponding to the character image code D20 matches the 
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character image specified by the character code Deo when the 
Euclidean distance is smaller than a predetermined threshold, and 
it is decided that these character images do not match when the 
Euclidean distance is larger than the threshold. 

As described above, since the character collation apparatus 
2000 of this twentieth embodiment is provided with the image 
feature extraction means 2001 which extracts the image feature of 
a character image specified by the character code Deo supplied 
from the outside to output image feature data Vc, the image 
feature data V20 included in the character image code D20 is 
compared with the image feature data Vc of the character image 
corresponding to the character code Deo. 

Therefore, it is possible to perform collation of 
corresponding character images between the character image code 
D20 to which the image feature data V20 is added, and the 
character code Deo. 

Accordingly, when the character image specified by the 
character code Deo matches the character image corresponding to 
the character image code D20, the character image corresponding 
to the character image code D2 0 is known without decoding the 
character image code D20, whereby the shape of the character 
image corresponding to the character image code D20 can be 
compared with the shape of another character image. 
(Embodiment 21) 

Figure 21 is a block diagram illustrating the structure of a 
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character collation apparatus according to a twenty- first 
embodiment of the present invention. This twenty-first 
embodiment corresponds to Claims 39 and 40. 

A character collation apparatus 2100 of this twenty-first 
embodiment is used as a component of an information retrieval 
apparatus employed in an electronic device such as the document 
filing apparatus 3900 shown in figure 39. 

The character collation apparatus 2100 receives a character 
code Deo specifying a character image supplied from the outside, 
collates a character image corresponding to a character image 
code D21 to which data of a predictive character image 
(predictive character image data PDi) similar to the above- 
mentioned character image is added, with the character image 
specified by the character code, and outputs data Sr showing the 
result of the collation. 

That is, the character collation apparatus 2100 is provided 
with a first image feature extraction means 2101 which receives 
the character image code D21, extracts the image feature from the 
predictive character image on the basis of the predictive 
character image data PDi added to the code D21, and outputs first 
image feature data Vcl; and a second image feature extraction 
means 2102 which receives the character code Deo, extracts the 
image feature of the character image specified by the character 
code, and outputs second image feature data Vc2 . 

The second image feature extraction means 2102 comprises a 
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character image generation means 2103 which generates data Di of 
a character image specified by the character code Deo; and a 
feature extraction means 2104 which outputs the second image 
feature data Vc2 on the basis of the character image data Di . 
The character image generation means 2103 is identical in 
structure to the character image generation means 2002 according 
to the twentieth embodiment, and each of the feature extraction 
means 2104 and the first image feature extraction means 2101 is 
identical in structure to the feature extraction means 1102 of 
the eleventh embodiment. Accordingly, the first and second image 
feature data Vcl and Vc2 are represented by feature vectors which 
are used for character recognition or the like in the eleventh 
embodiment, like the image feature data outputted from the 
feature extraction means 1102 of the image coding apparatus 1100 
of the eleventh embodiment. 

The character collation apparatus 2100 further includes a 
distance calculation means 2105 which obtains a Euclidean 
distance between the first image feature data Vcl outputted from 
the first image feature extraction means 2101 and the second 
image feature data Vc2 outputted from the second image feature 
extraction means 2103, and outputs distance information Cd; and a 
collation decision means 210 6 which outputs data Sr indicating 
the result of collation as to whether the character image 
corresponding to the character image code D21 matches the 
character image specified by the character code, on the basis of 
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the distance information Cd. 

Next, the operation will be described. 

When the character image code D21 and the character code Deo 
are input to the character collation apparatus 2100 of this 
twenty- first embodiment, the character image generation means 
2103 performs a process similar to that performed by the 
character image generation means 2002 of the twentieth embodiment 
on the basis of the character code Deo, and each of the feature 
extraction means 2104 and the first image feature extraction 
means 2101 performs an image feature extraction process similar 
to that performed by the feature extraction means 1102 of the 
eleventh embodiment. Thereby, first image feature data (feature 
vector) Vcl is output from the first image feature extraction 
means 2101, and second image feature data (feature vector) Vc2 is 
output from the feature extraction means 2104. 

In the distance calculation means 2105, on the basis of the 
first and second image feature data Vcl and Vc2, a Euclidean 
distance between these feature vectors is obtained, and distance 
information Cd is output. 

In the collation decision means 2106, it is decided that the 
character image corresponding to the character image code D21 
matches the character image specified by the character code Deo 
when the Euclidean distance is smaller than a predetermined 
threshold, and it is decided that these character images do not 
match when the Euclidean distance is larger than the threshold. 
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As described above, the character collation apparatus 2100 
of this twenty-first embodiment is provided with the first image 
feature extraction means 2101 which receives the character image 
code D21, and outputs the first image feature data Vcl 
corresponding to the predictive character image on the basis of 
the predictive character image data PDi which is added to the 
code D21; and the second image feature extraction means 2102 
which extracts the image feature of the character image specified 
by the character code Deo supplied from the outside, and outputs 
the second image feature data Vc2 . Thereby, the image feature 
data Vc2 of the character image corresponding to the character 
code Deo is compared with the feature image data Vcl of the 
predictive character image included in the character image code 
D21. 

Therefore, it is possible to perform collation of the 
corresponding character images between the character image code 
D21 to which the predictive character image data PDi is added, 
and the character code Deo. 

Accordingly, when it is decided that the character image 
specified by the character code Deo matches the predictive 
character image corresponding to the character image code D21, 
the character image corresponding to the character image code D21 
is known without decoding the character image code D21, whereby 
the shape of the character image corresponding to the character 
image code D21 can be compared with the shape of another 
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character image. 
(Embodiment. 22) 

Figure 22 is a block diagram illustrating the structure of a 
character collation apparatus according to a twenty-second 
embodiment of the present invention. This twenty-second 
embodiment corresponds to Claim 41. 

A character collation apparatus 2200 of this twenty-second 
embodiment is used as a component of an information retrieval 
apparatus employed in an electronic device such as the document 
filing apparatus 3900 shown in figure 39. 

The character collation apparatus 2200 receives a character 
code Deo specifying a character image supplied from the outside, 
collates a character image corresponding to a character image 
code D21 to which a predictive character image identifier Pid is 
added with the character image specified by the character code, 
and outputs data Sr showing the result of the collation. The 
predictive character image identifier Pid is an identifier for 
identifying a predictive character image similar to the character 
image specified by the character code Deo. 

That is, the character collation apparatus 2200 includes a 
table storage unit 2201 which stores a character-to-character 
distance table 3701 in which the predictive character image 
identifier Pid and the character code Deo are respectively 
associated with distance information calculated with the Pid and 
the Deo as variables; a distance calculation means 2202 which 
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receives the character image code D22 and the character code Deo, 
and obtains distance information Cd having, as variables, the 
predictive character image identifier Pid added to the character 
image code D22, and the character code Deo, with reference to the 
character-to-character distance table; and a collation decision 
means 2203 which outputs data Sr indicating the result of 
collation as to whether the character image corresponding to the 
character image code D22 matches the character image specified by 
the character code Deo. 

Figure 37 is a diagram for explaining the character-to- 
character distance table 3701. 

The predictive character image identifier Pid corresponds to 
each of the representative feature vectors which are obtained by 
quantizing the feature vectors by the vector quantization means 
1103 according to the eleventh embodiment. 

In the character-to-character distance table 3701, based on 
the value P(j) (j=0~n-l) of the predictive character image 
identifier Pid and the value S(i) (i=0~m-l) of the character 
code Deo, the value Dij of the distance information Cd having 
these values as variables is defined. 

Hereinafter, the distance information Cd will be described 
briefly. 

The value P(j) of each predictive character image identifier 
is associated with each representative feature vector V(j) 
according to the VQ code book. The value S(i) of the character 
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code corresponds to a feature vector W(i) which is obtained in 
the image feature extraction process performed on the character 
code, which process is similar to that performed by the image 
feature extraction means 2001 of the twentieth embodiment. 

Each element (value of distance information) Dij of the 
character-to-character distance table is a Euclidean distance 
between the feature vector W(i) and the representative feature 
vector V ( j ) . 

The element (value of distance information) Dij of the 
character-to-character distance table may be compared with a 
threshold T, and set at "1" when it is smaller than the threshold 
T and at "0" when it is equal to or larger than the threshold T. 
Thereby, the size of the table is reduced, resulting in high- 
speed collation. In this case, the collation decision means 2203 
decides that the character image matches the character code when 
the distance is "1", and decides that these do not match when the 
distance is "0". 

Next, the operation will be described. 

When the character image code D21 and the character code Deo 
are input to the character collation apparatus 22 00 of this 
twenty-second embodiment, initially, the distance calculation 
means 2202 calculates distance information Cd which is defined by 
the predictive character image identifier Pid added to the 
character image code D22 and the character code Deo, with 
reference to the character-to-character distance table 2201. The 
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value Dij of the distance information Cd is a Euclidean distance 
between the feature vector W(i) obtained from the value S(i) of 
the character code Deo and the representative feature vector V(j) 
obtained from the value P(j) of the predictive character image 
identifier Pid. 

In the collation decision means 2203, it is decided that the 
character image code D22 matches the character code Deo when the 
value Dij of the distance information is smaller than the 
predetermined threshold T, and it is decided that the character 
image code D22 does not match the character code Deo when the 
value Dij of the distance information is larger than the 
threshold T. 

As described above, the character collation apparatus 2200 
of this twenty-second embodiment is provided with the table 
storage unit 2201 which stores the character-to-character 
distance table 3701 in which the predictive character image 
identifier Pid added to the character image code D22 and the 
character code Deo are respectively associated with the distance 
information Cd which is defined with the Pid and the Deo as 
variables. The predictive character image identifier Pid is an 
identifier to identify the predictive character image similar to 
the character image corresponding to the character image code D22, 
and the value Dij of the distance information Cd is a Euclidean 
distance between the feature vector W(i) obtained from the value 
S(i) of the character code Deo and the representative feature 
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vector V(j) obtained from the value P(j) of the predictive 
character image identifier Pid. So, the feature vector 
corresponding to the character code Deo is compared with the 
feature vector corresponding to the predictive character image 
identifier included in the character image code D22 . 

Therefore, it is possible to collate the character image 
corresponding to the character image code D22 to which the 
predictive character image identifier Pid is added, with the 
character image corresponding to the character code Deo. 

Accordingly, when it is decided that the character image 
specified by the character code Deo matches the predictive 
character image corresponding to the character image code D22, 
the character image corresponding to the character image code D22 
is known by the inputted character code Deo without decoding the 
character image code D22, whereby the shape of the character 
image corresponding to the character image code D22 can be 
compared with the shape of another character image. 
(Embodiment 23) 

Figure 23 is a block diagram illustrating the structure of a 
character collation apparatus according to a twenty-third 
embodiment of the present invention. This twenty-third 
embodiment corresponds to Claims 42 and 43. 

A character collation apparatus 2300 of this twenty-third 
embodiment is used as a component of an information retrieval 
apparatus employed in an electronic device such as the document 
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filing apparatus 3900 shown in figure 39. 

The character collation apparatus 2300 receives a character 
code Deo specifying a character image supplied from the outside, 
collates a character image corresponding to a character image 
code D23 to which data of a predictive character image 
(predictive character image data PDi) similar to the above- 
mentioned character image is added, with the character image 
specified by the character code, and outputs data Sr showing the 
result of the collation. 

That is, the character collation apparatus 2300 is provided 
with a first image feature extraction means 2301 which receives 
the character image code D23, extracts the image feature from the 
predictive character image indicated by the predictive character 
image data PDi added to the code D23, and outputs first image 
feature data Vcl; and a second image feature extraction means 
2302 which receives the character code Deo, extracts the image 
feature of the character image specified by the character code, 
and outputs second image feature data Vc2 . 

The second image feature extraction means 2302 comprises a 
character image generation means 2303 which generates data Di of 
the character image specified by the character code Deo; and a 
feature extraction means 2304 which outputs the second image 
feature data Vc2 on the basis of the character image data Di . 
The character image generation means 2303 is identical in 
structure to the character image generation means 2002 according 
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to the twentieth embodiment, and the feature extraction means 
2304 is identical in structure to the feature extraction means 
1102 of the eleventh embodiment. The second image feature 
extraction means 2302 is identical in structure to the image 
feature extraction means 2001. Further, the first and second 
image feature data Vcl and Vc2 are represented by feature vectors 
which are used for character recognition or the like in the 
eleventh embodiment, like the image feature data outputted from 
the feature extraction means 1102 of the image coding apparatus 
1100 of the eleventh embodiment. 

The character collation apparatus 2300 further includes a 
distance calculation means 2305 which obtains a Euclidean 
distance between the first image feature data Vcl outputted from 
the first image feature extraction means 2301 and the second 
image feature data Vc2 outputted from the second image feature 
extraction means 2302, and outputs distance information Cd; and a 
collation decision means 2306 which outputs data Sr indicating 
the result of collation as to whether the character image 
corresponding to the character image code D23 matches the 
character image specified by the character code Deo, on the basis 
of the distance information Cd. 

It is assumed that the predictive image identifier is 
obtained by vector quantization described for the eleventh 
embodiment . 

Next, the operation will be described. 
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When the character image code D23 to which the predictive 
character image identifier Pid is added and the character code 
Deo are input to the character collation apparatus 2300 of this 
twenty- third embodiment, the first image feature extraction means 
2301 extracts the image feature from the predictive character 
image indicated by the predictive character image identifier Pid, 
and outputs first image character data Vcl. 

The character image generation means 2303 performs a process 
similar to that described for the character image generation 
means 2002 of the twentieth embodiment on the basis of the 
character code Deo. Further, the feature extraction means 2304 
performs an image feature extraction process similar to that 
described for the feature extraction means 1102 of the eleventh 
embodiment, and outputs second image feature data (feature 
vector) Vc2 . 

In the distance calculation means 2305, on the basis of the 
first and second image feature data Vcl and Vc2, a Euclidean 
distance between these feature vectors is obtained, and distance 
information Cd is output. 

In the collation decision means 2306, it is decided that the 
character image corresponding to the character image code D23 
matches the character image specified by the character code Deo 
when the Euclidean distance is smaller than a predetermined 
threshold, and it is decided that these character images do not 
match when the Euclidean distance is larger than the threshold. 
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If the predictive character image identifier Pid is a 
character code obtained as the result of character recognition 
performed on a character image, the first feature extraction 
means 2301 becomes identical in structure to the feature 
extraction means 2001 of the twentieth embodiment. 

As described above, the character collation apparatus 2300 
of this twenty-third embodiment is provided with the first image 
feature extraction means 2301 which receives the character image 
code D23, and outputs the first image feature data Vcl 
corresponding to the predictive character image on the basis of 
the predictive character image data Pid which is added to the 
code D23; and the second image feature extraction means 2302 
which extracts the image feature of the character image specified 
by the character code Deo supplied from the outside, and outputs 
the second image feature data Vc2 . Thereby, the image feature 
data Vc2 of the character image corresponding to the character 
code Deo is compared with the feature image data Vcl of the 
predictive character image included in the character image code 
D23. 

Therefore, it is possible to perform collation on the 
corresponding character images between the character image code 
D23 to which the predictive character image data Pid is added, 
and the character code Deo. 

Accordingly, when it is decided that the character image 
specified by the character code Deo matches the predictive 
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character image corresponding to the character image code D23 , 
the character image corresponding to the character image code D23 
is known by the inputted character code Deo without decoding the 
character image code D23, whereby the shape of the character 
image corresponding to the character image code D23 can be 
compared with the shape of another character image. 

It is possible to make a computer to perform the operation 
of an apparatus according to any of the aforementioned 
embodiments, by using a magnetic recording medium or an optical 
recording medium which contains a program for making the computer 
perform the functions of all or part of the plural means 
constituting the apparatus. Also in this case, the same effects 
as described above are achieved. 

While in the first to seventh embodiments a character code 
obtained from a character recognition apparatus is used as an 
image feature, a feature by which an image shape can be roughly 
reproduced, such as the mesh feature of the eighth embodiment, 
may be used. In this case, the predictive image generation means 
possessed by the respective apparatuses shown in figures 1 to 7 
have the same structure as that of the predictive image 
generation means 801. 

The apparatus having such structure can be applied not only 
to coding of a document image but also to coding of a general 
image . 

Further, while in the first to seventh embodiments a 
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character code obtained from a character recognition apparatus is 
used as an image feature, a predictive image identifier may be 
used by utilizing vector quantization described for the eleventh 
embodiment. In this case, the predictive image generation means 
possessed by the apparatuses shown in figures 1 to 7 becomes 
identical in structure to the predictive image generation means 
1104 shown in figure 11. 

Further, the image feature extraction means shown in figures 
2, 4, and 6 according to the second, fourth, and sixth 
embodiments may have the structure of an image feature extraction 
means 3801 shown in figure 38. 

The image feature extraction means 3801 comprises an area 
division means 3802 which extracts a partial image from an image 
on the basis of image data Di, and outputs partial image data 
Dbi; a feature extraction means 3803 which extracts a feature 
vector Vbi corresponding to each partial image on the basis of 
the corresponding partial image data Dbi; and a vector 
quantization means 3804 which obtains a predictive image 
identifier Dbip corresponding to a representative feature vector 
from the obtained feature vectors Vbi. 

An image coding apparatus having the image feature 
extraction means 3801 in place of the image feature extraction 
means according to the second, fourth, or sixth embodiment, 
outputs partial image feature data Dbid in which the character 
code in the character data Dc is replaced with the predictive 
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image identifier. 

Although a division method employed by the area division 
means 3802 depends on the type of a target image to be processed, 
when the target image is a document image, the means 3802 may 
employ a method described in "Analysis of Document Image 
Structure by Split Detection, Tsuji, The Institute of Electronics, 
Information and Communication Engineers, Vol . J74-D-II, No. 4, 
pp. 491-499" . 

Further, while in the eleventh and twelfth embodiments an 
identifier of a predictive image similar to a target image is 
obtained using vector quantization, a character recognition 
apparatus may be used when the target image is limited to a 
character . 

To be specific, in the image coding apparatus according to 
the eleventh embodiment shown in figure 11, a character 
recognition means is used instead of the image feature extraction 
means 1101, and a character code is output instead of the 
predictive character image identifier. In this case, the 
predictive image generation means shown in figures 11 and 12 must 
be identical in structure to the predictive image generation 
means 103 shown in figure 1. 

Furthermore, while in the first to fifteenth embodiments the 
entropy coding means, entropy decoding means, block predictive 
coding means, and block predictive decoding means perform 
arithmetic coding and arithmetic decoding adaptable to the 



164 



arithmetic coding, these coding and decoding means may perform 
Huffman coding and Huffman decoding adaptable to the Huffman 
coding. 

(Embodiment 24) 

Figure 42 is a block diagram illustrating the structure of 
an image coding apparatus according to a twenty-fourth embodiment 
of the present invention. This twenty-fourth embodiment 
corresponds to Claims 21 and 22. 

An image coding apparatus 4200 according to the twenty- 
fourth embodiment is used as an image coding means in an 
electronic device having a scanner, such as the document filing 
apparatus 3900 shown in figure 39 or a facsimile. 

The image coding apparatus 4200 receives, as target image 
data Dit to be coded, data of a character image corresponding to 
a character, and performs entropy coding on the target image data 
Dit with reference to a predictive image to output an entropy 
code Die as coded data of the target image . 

To be specific, the image coding apparatus 4200 includes an 
image feature extraction means 4201 which performs character 
recognition on the target image to output a character code Deo 
corresponding to the target image, and a first feature vector Vcl 
indicating the feature of the target image. 

The image feature extraction means 4201 comprises a feature 
extraction means 4202 which extracts the image feature from the 
target image to output the first feature vector Vcl; and a 
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character recognition means 4203 which performs character 
recognition on the target image using the first feature vector 
Vcl to output the character code Deo corresponding to the target 
image . 

The image coding apparatus 4200 further includes a 
predictive image selection means 4205 which receives the target 
image data Dit, and the character code Deo and the feature vector 
Vcl which are obtained from the target image data Dit, and 
selects either first predictive image data PDitl which is 
obtained by prediction based on the character code Deo 
corresponding to a character image to be currently processed 
(target image) or image data corresponding to an already- 
processed character image {second predictive image data PDit2) . 
The predictive image selection means 4205 outputs the selected 
predictive image data PDitl or PDit2, a flag FcO or Fcl 
indicating that either the first predictive image data PDitl or 
the second predictive image data PDit2 is selected, and the 
character code Deo corresponding to the target image. 

The image coding apparatus 420 0 further includes a 
predictive image generation means 4206 which receives the 
character code Deo corresponding to the target image through the 
predictive image selection means 42 05, and generates first 
predictive image data PDitl on the basis of a font image 
corresponding to the character code Deo of the target image; and 
a predictive image storage means 4207 which associates the target 
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image data Dit with the corresponding character code Deo and 
first feature vector Vcl, and stores them as a set of data 
corresponding to one entry. The predictive image generation 
means 420 6 is identical in structure to the predictive image 
generation means 103 in the image coding apparatus 100 according 
to the first embodiment. Further, the predictive image storage 
means 4207 receives a reguest from the predictive image selection 
means 4205, i.e., the character code Deo corresponding to the 
target image, and outputs the character image data and the 
feature vector corresponding to the character code Deo, as the 
second predictive image data PDit2 and the second feature vector 
Vc2, respectively. 

The image coding apparatus 4200 further includes an entropy 
coding means 4208 which performs arithmetic coding on the target 
image data Dit with reference to the first predictive image data 
PDitl or the second predictive image data PDit2 outputted from 
the predictive image selection means 4205, and outputs an entropy 
code Die corresponding to the target image. 

Next, the operation will be described. 

When image data Dit of a character image to be coded (target 
image) is input to the image coding apparatus 4200, the image 
feature extraction means 4201 generates a character code Deo and 
a first feature vector Vcl corresponding to the target image data 
Dit. 

To be specific, in the feature extraction means 4202, a 
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feature to be utilized in character recognition or the like is 
extracted from the target image, and a first feature vector Vcl 
corresponding to this feature is output. Then, in the character 
recognition means 4203, an image feature closest to the first 
feature vector Vcl and a character having the closest image 
feature are retrieved, and a character code Deo corresponding to 
this character is output. Since the character recognition method 
employed by the means 4203 is described in, for example, "Pattern 
Recognition, The Institute of Electronics, Information and 
Communication Engineers", it is not necessary to describe it in 
detail . 

Subsequently, in the predictive image selection means 4205, 
either the first predictive image data PDitl generated by the 
predictive image generation means 4206 or the second predictive 
image data PDit2 stored in the predictive image storage means 
4207 is selected according to the character code Deo and the 
first feature vector Vcl. Then, a flag FcO or Fcl indicating the 
selected predictive image data, and the character code Deo are 
output together with the selected predictive image data. 

In the entropy coding means 4208, the target image data Dit 
is subjected to arithmetic coding according to the predictive 
image data PDitl or PDit2 selected by the predictive image 
selection means 4205, and an entropy code Die is output as coded 
data of the target image. 

Hereinafter, the process performed by the predictive image 
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selection means 4205 will be described in detail. 

Figure 4 4 shows the operation flow of the predictive image 
selection means 4205. 

Initially, when the predictive image selection means 4205 
starts the process (step S4401) , the target image data Dit, the 
character code Deo from the image feature extraction means 4201, 
and the first feature vector Vcl are successively read into the 
means 4205 (steps S4402~S4404) . 

Next, it is decided whether there is an entry of the 
character code Deo of the target image in the predictive image 
storage means 4207 (step S4405). When there is an entry 
corresponding to the character code of the target image, the 
feature (second feature vector) Vc2 corresponding to the 
character code Deo is read from the predictive image storage 
means 4207 (step S4406) . 

Then, a Euclidean distance between the first feature vector 
Vcl and the second feature vector Vc2 is obtained (step S4407) , 
and it is decided whether this distance is larger than a 
predetermined threshold (step S4408). When the distance is 
larger than the threshold, the first predictive image data PDitl 
generated by the predictive image generation means 420 6 is output 
from the predictive image selection means 4205 to the entropy 
coding means 4208 (step S4409) , and simultaneously, the flag FcO 
indicating that the first predictive image data is selected is 
output together with the character code Deo of the target image 
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(step S4410) . 

On the other hand, when the result of the decision in step 
S4408 is that the Euclidean distance is equal to or smaller than 
the predetermined threshold, the character image data 
corresponding to the character code Deo, which is stored in the 
predictive image storage means 4207, is output as the second 
predictive image data PDit2 for the target image, from the 
predictive image selection means 4205 to the entropy coding means 
4208 (step S4411), and simultaneously, the flag Fcl indicating 
that the second predictive image data PDit2 is selected is output 
together with the character code Deo of the target image (step 
S4412) . 

Finally, the target image data Dit, the character code Deo, 
and the feature (first feature vector) Vcl, which have been read 
into the predictive image selection means 42 05 through steps 
S4402—S4404, are stored in the predictive image storage means 
4207 as a set of data corresponding to a new entry (step S4413) . 

When the data of the new entry corresponding to the 
character code Deo of the target image is stored in the 
predictive image storage means 4207, if an entry corresponding to 
the same character code Deo has already been stored in the 
storage means 42 07, the feature and the target image data 
corresponding to the already-existing entry are replaced with 
those corresponding to the new entry, or the feature and the 
target image data corresponding to the character code Deo of the 
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target image are respectively averaged between the new entry and 
the existing entry and then the. feature and the target image data 
corresponding to the existing entry are replaced with the 
averaged feature and the averaged target image data. 

As described above, the image coding apparatus 4200 of this 
twenty-fourth embodiment is provided with the predictive image 
generation means 4206 which generates the first predictive image 
data PDitl (i.e., the data of the font image corresponding to the 
character code of the target image) on the basis of the character 
code Deo of the target image; and the predictive image storage 
means 4207 which stores the target image data Dit, and the 
corresponding character code Deo and first feature vector Vcl in 
association with each other. Between the font image obtained 
from the character code of the target image (first predictive 
image) and the character image which has already been coded 
(second predictive image), one of higher similarity to the target 
image is selected as a predictive image, and the arithmetic 
coding on the target image data is performed while switching the 
incidence probability model according to the selected predictive 
image data. Therefore, the coding efficiency of the arithmetic 
encoder is improved and, furthermore, the process of generating 
predictive image data for the target image is dispensed with when 
the character image to be coded is identical to the already-coded 
character image, whereby the load on the arithmetic coding 
process using the predictive image is reduced. 
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Further, since the character code Deo corresponding to the 
target image is output together with the entropy code Die 
corresponding to the target image, the coded data Die of the 
target image can be retrieved using the character code. 
(Embodiment 25) 

Figure 43 is a block diagram illustrating an image decoding 
apparatus according to a twenty- fifth embodiment of the present 
invention. This twenty-fifth embodiment corresponds to Claims 23 
and 24. 

An image decoding apparatus 4300 according to the twenty- 
fifth embodiment is adapted to the image coding apparatus 4200 
according to the twenty-fourth embodiment, and it is used as an 
image decoding means in an electronic device having a scanner, 
such as the document filing apparatus 3900 shown in figure 39 or 
a facsimile. 

That is, the image decoding apparatus 4300 receives the 
entropy code (coded data) Die, the character code Deo, and the 
flag FcO or Fcl, which are output from the image coding apparatus 
4200 of the twenty-fourth embodiment, and subjects the coded data 
Die to arithmetic decoding with reference to the predictive image 
data PDit which is generated according to the character code Deo 
and the flag FcO or Fcl, thereby restores the target image data 
Did. 

To be specific, the image decoding apparatus 43 00 includes a 
predictive image generation means 4302 which generates first 
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predictive image data PDitl for the target image by using the 
font information or the like, on the basis of the character code 
Deo of the target image inputted; and a predictive image storage 
means 4303 which associates the target image data Dit with the 
corresponding character code Deo, and stores them as a set of 
data corresponding to one entry. The predictive image generatioi 
means 4302 is identical in structure to the predictive image 
generation means 103 of the image coding apparatus 100 according 
to the first embodiment. Further, the predictive image storage 
means 4303 receives the character code Deo corresponding to the 
target image, and outputs the character image data corresponding 
to the character code Deo as the second predictive image data 
PDit2. 

The image decoding apparatus 430 0 further includes a 
predictive image selection means 4301 which selects either the 
first predictive image data PDitl obtained from the predictive 
image generation means 4302 or the second predictive image data 
PDit2 obtained from the predictive image storage means 4303, on 
the basis of the character code Deo corresponding to the entropy 
code Die to be decoded, and the flag FcO or Fcl . 

Further, the image decoding apparatus 4300 includes an 
entropy decoding means 4304 which performs arithmetic decoding on 
the entropy code Die with reference to the first predictive image 
data PDitl or the second predictive image data PDit2 outputted 
from the predictive image selection means 43 02, and outputs the 
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decoded data as target image data Did. The entropy decoding 
means 4304 is identical in structure to the entropy decoding 
means 306 of the image decoding apparatus 300 according to the 
third embodiment . 

Next, the operation will be described. 
When the image decoding apparatus 4300 receives the 
character code Deo corresponding to the character image that is 
the target of coding (target image), the flag FcO or Fcl, and the 
entropy code Die, which are output from the image coding 
apparatus 42 00 of the twenty-fourth embodiment, the predictive 
image selection means 4301 selects either the first predictive 
image data PDitl generated by the predictive image generation 
means 4302 or the second predictive image data PDit2 stored in 
the predictive image storage means 4303, according to the 
character code Deo and the flag FcO or Fcl. Then, the selected 
predictive image data PDitl or PDit2 and the corresponding flag 
FcO or Fcl are output to the entropy decoding means 4304. 

In the entropy decoding means 4304, the entropy code Die is 
subjected to arithmetic decoding according to the predictive 
image data PDitl or PDit2 selected by the predictive image 
selection means 4301, and target image data Did is output as 
decoded data of the target image. 

Hereinafter, the process performed by the predictive image 
selection means 4301 will be described in detail. 

Figure 45 shows the operation flow of the predictive image 
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selection means 4301. 

Initially, when the predictive image selection means 4301 
starts the process (step S4501), the character code Deo 
corresponding to the target image and the flag FcO or Fcl, which 
are output from the image coding apparatus 4200, are successively 
read into the means 4301 (steps S4502 and S4503) . 

Then, it is decided that the inputted flag is either the 
flag FcO indicating that the first predictive image data PDitl 
generated by the predictive image generation means 4302 is to be 
used for decoding the entropy code, or the flag Fcl indicating 
that the second predictive image data PDit2 stored in the 
predictive image storage means 4303 is to be used (step S4504) . 

When the inputted flag is the flag Fcl, the character image 
data (second predictive image data) corresponding to the 
character code Deo is read from the predictive image storage 
means 4303 (step S4505) . 

When the inputted flag is the flag FcO, the first predictive 
image data PDitl generated in the predictive image generation 
means 4302 according to the character code Deo is read (step 
S4506) . 

Then, the decoded data (target image data) Did, which is 
obtained by performing arithmetic decoding on the entropy code by 
using the predictive image data PDitl or PDit2 selected by the 
predictive image selection means 4301, and the corresponding 
character code Deo are stored in the predictive image storage 
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means 4303 as a set of data corresponding to a new entry (step 
S4507) . 

When the data of the new entry corresponding to the 
character code Deo of the target image is stored in the 
predictive image storage means 4303, if an entry corresponding to 
the same character code Deo has already been stored in the 
storage means 4303, the feature and the target image data 
corresponding to the already-existing entry are replaced with 
those corresponding to the new entry, or the feature and the 
target image data corresponding to the character code Deo of the 
target image are respectively averaged between the new entry and 
the existing entry and then the feature and the target image data 
corresponding to the existing entry are replaced with the 
averaged feature and the averaged target image data. 

As described above, the image decoding apparatus 4300 of 
this twenty-fifth embodiment is provided with the predictive 
image generation means 4302 which generates the first predictive 
image data PDitl (i.e., the data of the font image corresponding 
to the character code of the target image) on the basis of the 
character code Deo of the target image; and the predictive image 
storage means 4303 which stores the target image data Did and the 
corresponding character code Deo in association with each other. 
Between the font image obtained from the character code of the 
target image (first predictive image) and the character image 
which has already been decoded (second predictive image), one of 
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higher similarity to the target image is selected as a predictive 
image, and the arithmetic decoding on the entropy code of the 
target image is performed while switching the incidence 
probability model according to the selected predictive image data. 
Therefore, it is possible to realize an arithmetic decoding 
process adapted to an arithmetic coding process which provides 
high coding efficiency of the arithmetic encoder, and omits the 
process of generating predictive image data for the target image 
when the character image to be coded is identical to the already- 
coded character image, thereby reducing the arithmetic load. 

Further, in the image decoding apparatus 4300, since the 
character code Deo corresponding to the target image is received 
together with the entropy code Die corresponding to the target 
image, the coded data Die of the target image can be retrieved 
using the character code. 

Further, while in the twenty-fourth embodiment the entropy 
coding means performs arithmetic coding, it may perform Huffman 
coding. 

Furthermore, while in the twenty-fifth embodiment the 
entropy decoding means performs arithmetic decoding, it may 
perform Huffman decoding. 

A facsimile provided with the image coding apparatus 4200 of 
the twenty- fourth embodiment and the image decoding apparatus 
4300 of the twenty-fifth embodiment is realized by replacing the 
image coding unit 200a and the image decoding unit 300a in the 
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facsimile shown in figure 41(a) with the image coding apparatus 
4200 and the image decoding apparatus 4300, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 4200 of the twenty-fourth embodiment and 
the image decoding apparatus 4300 of the twenty-fifth embodiment 
is realized by replacing the image coding unit 200a and the image 
decoding unit 300a in the document filing apparatus shown in 
figure 41(b) with the image coding apparatus 4200 and the image 
decoding apparatus 4300, respectively. 
(Embodiment 26) 

Figure 4 6 is a block diagram illustrating an image coding 
apparatus according to a twenty-sixth embodiment of the present 
invention. This twenty-sixth embodiment corresponds to Claims 25 
and 26. 

An image coding apparatus 4 600 of this twenty-sixth 
embodiment is used as an image coding means in an electronic 
device having a scanner, such as the document filing apparatus 
3900 shown in figure 39 or a facsimile. 

The image coding apparatus 4 600 receives, as target image 
data Dit to be coded, data of a character image corresponding to 
a character, performs entropy coding on the target image data Dit 
according to a feature indicating an image feature of the 
character image, and outputs an entropy code Die as coded data of 
the target image, and information relating to the entropy coding 
process . 
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To be specific, the image coding apparatus 4 600 includes an 
image feature extraction means 4601 which performs character 
recognition on the target image to output a character code Deo 
corresponding to the target image, and a feature vector (first 
feature vector) Vcl indicating the feature of the target image. 
The image feature extraction means 4601 comprises a feature 
extraction means 4602 which extracts the image feature from the 
target image to output the first feature vector Vcl; and a 
character recognition means 4603 which performs character 
recognition on the target image using the first feature vector 
Vcl to output the character code Deo corresponding to the target 
image . 

The image coding apparatus 4 600 further includes a 
predictive image selection means (data output control means) 4604 
which performs either a first data output process or a second 
data output process according to the character code Deo obtained 
from the target image data Dit and the first feature vector Vcl. 
In the first data output process, a character code Deo 
corresponding to a character image which is currently processed 
(target image) , predictive image data PDitl, and a flag FcO are 
output. In the second data output process, the character code 
Deo of the target image and a flag Fcl are output. 

The image coding apparatus 4 600 further includes a 
predictive image generation means 4 605 which receives the 
character code Deo corresponding to the target image through the 
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predictive image selection means 4604, and outputs image data of 
a font image corresponding to the character code Deo of the 
target image as the first predictive image data PDitl; and a 
predictive image storage means 4 606 which associates the target 
image data Dit with the corresponding character code Deo and 
feature vector (first feature vector) Vcl, and stores them as a 
set of data corresponding to one entry. 

The image feature extraction means 4 601 is identical in 
structure to the image feature extraction means 4201 of the 
twenty- fourth embodiment, and the predictive image generation 
means 4 605 is identical in structure to the predictive image 
generation means 103 of the image coding apparatus 100 according 
to the first embodiment. Further, the predictive image storage 
means 4 60 6 receives a request from the predictive image selection 
means 4 603, i.e., the character code Deo corresponding to the 
target image, and outputs the feature vector (second feature 
vector) Vc2 indicating the image feature of an already-processed 
character image which is specified by the character code Deo. 

The image coding apparatus 4 600 further includes an entropy 
coding means 4 607 which performs, when receiving the flag FcO, 
arithmetic coding on the target image data Dit, with reference to 
the predictive image data PDitl for the target image, utilizing 
the correlation in pixel values between the target image and the 
predictive image, and outputs an entropy code Die as coded data 
of the target image. When receiving the flag Fcl, the entropy 
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coding means 4 607 does not perform arithmetic coding on the 
target image data Dit and, therefore, does not output coded data. 
Next, the operation will be described. 

When image data Dit of a character image to be coded (target 
image) is input to the image coding apparatus 4 600, the image 
feature extraction means 4601 generates a character code Deo and 
a feature vector (first feature vector) Vcl corresponding to the 
target image data Dit. 

To be specific, in the feature extraction means 4 602, a 
feature to be utilized in character recognition or the like is 
extracted from the target image, and the first feature vector Vcl 
corresponding to this feature is output. Then, in the character 
recognition means 4 603, a character having an image feature 
closest to the image feature indicated by the first feature 
vector Vcl is retrieved, and a character code Deo corresponding 
to this character is output. Since the character recognition 
method employed by the means 4 603 is described in, for example, 
"Pattern Recognition, The Institute of Electronics, Information 
and Communication Engineers", it is not necessary to describe it 
in detail. 

Subsequently, in the predictive image selection means 4604, 
one of the first and second data output processes is selected 
according to the character code Deo and the first feature vector 
Vcl. When the first data output process is selected, the 
character code Deo of the character image which is currently 
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processed (target image), the predictive image data PDitl, and 
the flag FcO are output. On the other hand, when the second data 
output process is selected, the character code Deo of the target 
image and the flag Fcl are output. 

When the entropy coding means 4 607 receives the flag FcO, it 
performs arithmetic coding on the target image data Dit with 
reference to the predictive image data PDitl for the target image, 
and outputs an entropy code Die as coded data of the target image. 
On the other hand, when the coding means 4 607 receives the flag 
Fcl, it does not perform arithmetic coding on the target image 
data Dit and, therefore, does not output coded data. 

Hereinafter, the process performed by the predictive image 
selection means 4604 will be described in detail. 

Figure 48 shows the operation flow of the predictive image 
selection means 4604. 

Initially, when the predictive image selection means 4 604 
starts the process (step S4801), the character code Deo from the 
image feature extraction means 4 601 and the first feature vector 
Vcl are successively read into the means 4604 (steps S4802 and 
S4803) . 

Next, it is decided whether there is an entry of the 
character code Deo of the target image in the predictive image 
storage means 4606 (step S4804) . When there is an entry 
corresponding to the character code of the target image, the 
feature (second feature vector) Vc2 corresponding to the 
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character code Deo is read from the predictive image storage 
means 4605 (step S4805) . 

Then, a Euclidean distance between the first feature vector 
Vcl and the second feature vector Vc2 is obtained (step S4806) , 
and it is decided whether this distance is larger than a 
predetermined threshold (step S4807) . When the distance is 
larger than the threshold, the first predictive image data PDitl 
generated by the predictive image generation means 4 605 is output 
from the predictive image selection means 4 604 to the entropy 
coding means 4607 (step S4808), and simultaneously, the flag FcO 
is output together with the character code Deo of the target 
image (step S4809) . 

On the other hand, when the result of the decision in step 
S4807 is that the Euclidean distance is equal to or smaller than 
the predetermined threshold, the flag Fcl is output together with 
the character code Deo of the target image (step S4810) . 

Finally, the character code Deo and the feature (first 
feature vector) Vcl, which have been read into the predictive 
image selection means 4604 through steps S4802 and S4803, are 
stored in the predictive image storage means 4606 as a set of 
data corresponding to a new entry (step S4812) . 

When the data of the new entry corresponding to the 
character code Deo of the target image is stored in the 
predictive image storage means 4 606, if an entry corresponding to 
the same character code Deo has already been stored in the 
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storage means 4606, the feature corresponding to the already- 
existing entry is replaced with that corresponding to the new 
entry, or the feature is averaged between the new entry and the 
existing entry and then the feature corresponding to the existing 
entry is replaced with the averaged feature. 

As described above, the image coding apparatus 4 600 of this 
twenty-sixth embodiment is provided with the predictive image 
generation means 4 605 which generates the first predictive image 
data PDitl (i.e., the data of the font image corresponding to the 
character code of the target image) on the basis of the character 
code Deo of the target image; and the predictive image storage 
means 4 606 which stores the target image data Dit, and the 
corresponding character code Deo and first feature vector Vcl in 
association with each other. Based on the result of comparison 
between the feature vector (first feature vector) Vcl of the 
target character image to be processed and the feature vector 
(second feature vector) Vc2 corresponding to the already- 
processed character image, either the first data processing (i.e., 
performing arithmetic coding on the target image using the font 
image as a predictive image, and outputting the entropy code Die, 
the character code Deo, and the flag Fcl) or the second data 
processing (i.e., outputting only the character code Deo and the 
flag Fcl) is performed. Therefore, the coding efficiency of the 
arithmetic encoder is improved and, furthermore, the process of 
generating predictive image data for the target image and the 
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process of performing arithmetic coding on the target image data 
are dispensed with when the target character image to be coded is 
identical to the already-coded character image, whereby the load 
on the arithmetic coding process using the predictive image is 
reduced. 

Further, since the character code Deo of the target 
character image to be coded is output regardless of the first or 
second data processing, the coded data Die of the target image 
can be retrieved using the character code. 
(Embodiment 27) 

Figure 47 is a block diagram illustrating an image decoding 
apparatus according to a twenty-seventh embodiment of the present 
invention. This twenty-seventh embodiment corresponds to Claims 
27 and 28. 

An image decoding apparatus 4700 according to the twenty- 
seventh embodiment is adapted to the image coding apparatus 4 600 
according to the twenty-sixth embodiment, and it is used as an 
image decoding means in an electronic device having a scanner, 
such as the document filing apparatus 3900 shown in figure 39 or 
a facsimile. 

That is, the image decoding apparatus 4700 receives the 
entropy code (coded data) Die, the character code Deo, and the 
flag FcO or Fcl, which are output from the image coding apparatus 
4600 of the twenty-sixth embodiment, and subjects the coded data 
Die to arithmetic decoding based on the character code Deo and 
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the flag FcO or Fcl, thereby restores the target image data Did. 

To be specific, the image decoding apparatus 4700 includes a 
predictive image generation means 4702 which generates first 
predictive image data PDitl for the target image by using the 
font information or the like, on the basis of the character code 
Deo of the target image inputted; and a predictive image storage 
means 4703 which associates the target image data Dit with the 
corresponding character code Deo, and stores them as a set of 
data corresponding to one entry. The predictive image generation 
means 4702 is identical in structure to the predictive image 
generation means 103 of the image coding apparatus 100 according 
to the first embodiment. Further, the predictive image storage 
means 4703 receives the character code Deo corresponding to the 
target image, and outputs the character image data which is 
associated with the character code Deo, as the second predictive 
image data PDit2 . 

The image decoding apparatus 4700 further includes a 
predictive image selection means 4701 which selects either the 
first predictive image data PDitl obtained from the predictive 
image generation means 4702 or the second predictive image data 
PDit2 obtained from the predictive image storage means 47 03, on 
the basis of the character code Deo corresponding to the entropy 
code Die to be decoded, and the flag FcO or Fcl, and outputs the 
selected data together with the corresponding flag FcO or Fcl. 

Further, the image decoding apparatus 4700 includes an 
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entropy decoding means 4704 which performs either a first data 
processing or a second data processing according to the flag FcO 
or Fcl. The first data processing is subjecting the entropy code 
Die to arithmetic decoding with reference to the first predictive 
image data PDitl outputted from the predictive image selection 
means 4702, and outputting the decoded data as the target image 
data Did, and the second data processing is outputting the second 
predictive image data PDit2 as it is. 

The flag FcO indicates that arithmetic decoding with 
reference to the first predictive image data PDitl obtained from 
the predictive image generation means 4702 should be performed, 
and the flag Fcl indicates that the second predictive image data 
PDit2 obtained from the predictive image storage means 4703 
should be output as decoded data. 

Next, the operation will be described. 
When the image decoding apparatus 4700 receives the 
character code Deo corresponding to the character image that has 
been the target of coding (target image) , the flag FcO or Fcl, 
and the entropy code Die, which are output from the image coding 
apparatus 4 600 of the twenty-sixth embodiment, the predictive 
image selection means 4701 selects either the first predictive 
image data PDitl generated by the predictive image generation 
means 4702 or the second predictive image data PDit2 stored in 
the predictive image storage means 4703, according to the 
character code Deo and the flag FcO or Fcl. Then, the selected 
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predictive image data PDitl or PDit2 and the corresponding flag 
FcO or Fcl are output to the entropy decoding means 4704. 

The entropy decoding means 4704 performs either the first 
data processing to perform arithmetic decoding on the entropy 
code Die using the predictive image data PDitl selected by the 
predictive image selection means 4701 to restore the target image 
data Did, or the second data processing to output the predictive 
image data PDit2 selected by the predictive image selection means 
4701 as decoded data. 

Hereinafter, the process performed by the predictive image 
selection means 4701 will be described in detail. 

Figure 47 shows the operation flow of the predictive image 
selection means 4701. 

Initially, when the predictive image selection means 4701 
starts the processing (step S4701) , the character code Deo 
corresponding to the target image and the flag FcO or Fcl, which 
are output from the image coding apparatus 4600, are successively 
read into the means 4701 (steps S4702 and S4703) . 

Then, it is decided that the inputted flag is either the 
flag FcO indicating that the first predictive image data PDitl 
generated by the predictive image generation means 4702 is to be 
used for decoding the entropy code, or the flag Fcl indicating 
that the second predictive image data PDit2 stored in the 
predictive image storage means 4703 is to be used (step S4704) . 

When the inputted flag is the flag Fcl, the character image 



data (second predictive image data) corresponding to the 
character code Deo is read from the predictive image storage 
means 4703 (step S4705) . 

When the inputted flag is the flag FcO, the first predictive 
image data PDitl generated in the predictive image generation 
means 4702 according to the character code Deo is read (step 
S4706) . 

Then, the decoded data (target image data) Did, which is 
obtained by decoding using the predictive image data PDitl or 
PDit2 selected by the predictive image selection means 4701, and 
the corresponding character code Deo are stored in the predictive 
image storage means 4703 as a set of data corresponding to a new- 
entry. 

When the data of the new entry corresponding to the 
character code Deo of the target image is stored in the 
predictive image storage means 4703, if an entry corresponding to 
the same character code Deo has already been stored in the 
storage means 4703, the target image data corresponding to the 
already-existing entry is replaced with that corresponding to the 
new entry, or the target image data corresponding to the 
character code Deo of the target image is averaged between the 
new entry and the existing entry and then the target image data 
corresponding to the existing entry is replaced with the averaged 
target image data. 

As described above, the image decoding apparatus 4700 of 
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this twenty-seventh embodiment is provided with the predictive 
image generation means 4702 which generates the first predictive 
image data PDitl (i.e., the data of the font image corresponding 
to the character code of the target image) on the basis of the 
character code Deo of the target image; and the predictive image 
storage means 4703 which stores the target image data Did and the 
corresponding character code Deo in association with each other. 
Between the font image obtained from the character code of the 
target image (first predictive image) and the character image 
which has already been decoded (second predictive image) , one of 
higher similarity to the target image is selected, whereby either 
the first data processing (i.e., performing arithmetic decoding 
on the entropy code of the target image while switching the 
incidence probability model according to the first predictive 
image data to generate decoded data) or the second data 
processing (i.e., outputting the second predictive image data as 
it is) is performed. Therefore, it is possible to realize an 
arithmetic decoding process adaptable to an arithmetic coding 
process which provides high coding efficiency of the arithmetic 
encoder, and omits the process of generating predictive image 
data for the target image and the process of arithmetically 
coding the target image data when the character image to be coded 
is identical to the already-coded character image, thereby 
reducing the arithmetic load. 

Further, in the image decoding apparatus 4700, since the 
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character code Deo corresponding to the target image is received 
together with the entropy code Die corresponding to the target 
image, the coded data Die of the target image can be retrieved 
using the character code. 

While in the twenty-sixth embodiment the entropy coding 
means performs arithmetic coding, it may perform Huffman coding. 

Further, while in the twenty-seventh embodiment the entropy 
decoding means performs arithmetic decoding, it may perform 
Huffman decoding. 

A facsimile provided with the image coding apparatus 4 600 of 
the twenty-sixth embodiment and the image decoding apparatus 4700 
of the twenty-seventh embodiment is realized by replacing the 
image coding unit 200a and the image decoding unit 300a in the 
facsimile shown in figure 41(a) with the image coding apparatus 
4 600 and the image decoding apparatus 4700, respectively. 

Furthermore, a document filing apparatus provided with the 
image coding apparatus 4 600 of the twenty-sixth embodiment and 
the image decoding apparatus 4700 of the twenty-seventh 
embodiment is realized by replacing the image coding unit 2 00a 
and the image decoding unit 300a in the document filing apparatus 
shown in figure 41(b) with the image coding apparatus 4600 and 
the image decoding apparatus 4700, respectively. 

When a program for making a computer perform the image 
coding process, image decoding process, or character collation 
process according to any of the aforementioned embodiments is 
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recorded on a data storage medium such as a floppy disk, the 
process described for any of the embodiments can be easily 
performed with an independent computer system. 

Figures 40(a), 40(b), and 40(c) are diagrams for explaining 
the case where the processing described for any of the 
embodiments of the invention is performed with a computer system, 
using a floppy disk containing the above-described program. 

Figure 40(b) shows a floppy disk, to be specific, its 
outward appearance, cross-section, and disk itself. Figure 40(a) 
shows an example of a physical format of the floppy disk as a 
recording medium body. The floppy disk FD is contained in a case 
F. On the surface of the floppy disk FD, a plurality of tracks 
Tr are formed concentrically along the radius of the disk, and 
each track is divided into sixteen sectors Se at equal angles. 
Accordingly, on the floppy disk FD containing the above-mentioned 
program, data as the program is recorded in an assigned area of 
the floppy disk FD. 

Figure 40(c) shows a construction for recording and playback 
of the program in/from the floppy disk FD. When the program is 
recorded in the floppy disk, data as the program is written in 
the disk from a computer system Cs through a floppy disk drive 
FDD. When, the above-described image coding apparatus, image 
decoding apparatus, or character collation apparatus is 
constructed in the computer system using the program recorded in 
the floppy disk, the program is read from the floppy disk and 
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transmitted to the computer system by the floppy disk drive FDD. 

While in the above description a floppy disk is employed as 
a data recording medium, an optical disk may be employed. 
Further, any recording medium, such as IC card or ROM cassette, 
may be employed as long as it can store the program. 

APPLICABILITY IN INDUSTORY 

As described above, the image coding apparatuses, image 
decoding apparatuses, character collation apparatuses, and data 
storage media according to the present invention are able to 
improve the image coding efficiency. Especially, these 
apparatuses are very useful in a facsimile for transmitting 
images, especially document images, and in a filing apparatus for 
storing document images to be retrieved. 
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CLAIMS 

1. An image coding apparatus for coding image data corresponding 
to a target image to be coded, on the basis of image data 
corresponding to a predictive image similar to the target image, 
said apparatus comprising: 

predictive image generation means for generating image data 
corresponding to partial predictive images which are similar to 
plural partial images constituting the target image, on the basis 
of image feature data indicating features of the plural partial 
images; 

image composition means for compositing the plural partial 
predictive images on the basis of the image data of the plural 
partial predictive images and auxiliary data indicating the 
positions and sizes of the respective partial images in the 
target image, thereby generating image data of the predictive 
image; and 

entropy coding means for subjecting the image data of the 
target image to entropy coding utilizing the correlation in pixel 
values between the target image and the predictive image, and 
outputting entropy codes as coded image data of the target image; 
and 

said image coding apparatus outputting the image feature data 
and the auxiliary data as well as the entropy codes. 



194 



2. An image coding apparatus as defined in Claim 1 further 
comprising: 

image feature extraction means for generating the image 
feature data indicating the features of the respective partial 
images constituting the target image, and the auxiliary data 
indicating the positions and sizes of the respective partial 
images in the target image, on the basis of the image data of the 
target image . 

3. An image coding apparatus as defined in Claim 2 wherein: 
said entropy coding means comprises: 

first image blocking means for dividing the image data 
of the predictive image into image data corresponding to plural 
predictive blocks constituting the predictive image and each 
having a predetermined size, and outputting the image data of 
each predictive block; 

second image blocking means for dividing the image data 
of the target image into image data corresponding to plural 
target blocks constituting the target image and each having a 
predetermined size, and outputting the image data of each target 
block; and 

block predictive coding means for subjecting the image 
data of each target block to entropy coding on the basis of the 
correlation in pixel values between each predictive block and 
each target block; and 
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said block predictive coding means performs entropy coding on 
the image data of the target block and outputs the corresponding 
coded image data and a coding flag when the difference between 
the target block and the predictive block is equal to or larger 
than a predetermined reference value; on the other hand, the 
block predictive coding means does not perform entropy coding on 
the target block and outputs a non-coding flag when the 
difference between the target block and the predictive block is 
smaller than the reference value. 

4. An image coding apparatus as defined in Claim 2 further 
comprising: 

image filtering means for subjecting the image data of the 
predictive image to filtering so that minute portions of the 
predictive image are omitted, and outputting the filtered data of 
the predictive image; and 

said entropy coding means subjecting the image data of the 
target image to entropy coding on the basis of the filtered data. 

5. An image decoding apparatus for decoding coded image data 
obtained by subjecting image data corresponding to a target image 
to be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image, said apparatus comprising: 

predictive image generation means for generating image data 
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corresponding to partial predictive images similar to plural 
partial images constituting the target image, on the basis of 
image feature data indicating features of the plural partial 
images ; 

image composition means for compositing the plural partial 
predictive images on the basis of the image data of the plural 
partial predictive images and auxiliary data indicating the 
positions and sizes of the partial images in the target image, 
thereby generating image data of the predictive image; and 

entropy decoding means for subjecting the coded image data o 
the target image to entropy decoding utilizing the correlation in 
pixel values between the target image and the predictive image, 
on the basis of the image data of the predictive image, thereby 
generating image data of the target image. 

6. An image decoding apparatus for receiving the coded image 
data, the coding flag or non-coding flag, the image feature data, 
and the auxiliary data which are output from the image coding 
apparatus defined in Claim 3, and generating decoded image data 
of the target image, said apparatus comprising: 

predictive image generation means for generating image data 
corresponding to partial predictive images similar to plural 
partial images constituting the target image, on the basis of 
image feature data indicating the features of the plural partial 
images; 
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image composition means for compositing the plural partial 
predictive images on the basis of the image data of the plural 
partial predictive images and auxiliary data indicating the 
positions and sizes of the partial images in the target image, 
thereby generating image data of the predictive image; 

image blocking means for dividing the image data of the 
predictive image into image data corresponding to plural 
predictive blocks constituting the predictive image and each 
having a predetermined size, and outputting the image data of 
each predictive block; 

block predictive decoding means for subjecting the coded 
image data of the target block to entropy decoding utilizing the 
correlation in pixel values between the target block and the 
predictive block, on the basis of the image data of the 
respective predictive blocks, thereby generating image data of 
the target block; and 

block assembly means for receiving the image data of the 
predictive blocks and the image data of the target blocks, and 
assembling the target image using the target blocks and the 
predictive blocks, on the basis of the coding flag and the non- 
coding flag, thereby restoring the image data of the target image. 

7. (Amended) An image decoding apparatus as defined in Claim 5 
further comprising: 

an image filtering means for subjecting the image data of the 
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predictive image to filtering such that minute portions of the 
predictive image are omitted, and outputting the filtered data of 
the predictive image; and 

said entropy decoding means subjecting the coded image data 
of the target image to entropy decoding on the basis of the 
filtered data. 

8. An image coding apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image similar to the target image, said apparatus comprising: 

predictive image generation means for generating image data 
of the predictive image similar to the target image, on the basis 
of image feature data indicating the feature of the target image; 
and 

entropy coding means for subjecting the image data of the 
target image to entropy coding utilizing the correlation in pixel 
values between the target image and the predictive image, and 
outputting entropy codes as coded image data of the target image; 
and 

said image coding apparatus outputting the entropy codes and 
the image feature data corresponding to the target image. 

9. An image coding apparatus as defined in Claim 8 further 
comprising image feature extraction means for extracting the 
image feature from the target image on the basis of the image 
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data of the target image, and outputting the image feature data 
to the predictive image generation means . 

10. An image coding apparatus as defined in Claim 9 wherein: 
said image feature extraction means comprises: 

blocking means for dividing the image data of the 
target image into plural blocks constituting the target image and 
each having a predetermined size, thereby generating image data 
corresponding to the respective blocks; and 

block smoothing means for replacing the image data of 
each block with a pixel value of the highest occurrence frequency 
among the pixel values of pixels in the block, and outputting, as 
image feature data of the target image, image data of a reduced 
image comprising the highest-frequency pixel values of the 
respective blocks; and 

said predictive image generation means generates image data 
of a predictive image in which all of the pixels constituting 
each block have the highest-frequency pixel values corresponding 
to the target block, which is obtained by enlarging the 
respective pixels of the reduced image to the blocks of the 
predetermined size. 

11. An image coding apparatus as defined in Claim 9 wherein: 
said image feature extraction means comprises: 

feature vector extraction means for outputting a 
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feature vector indicating the feature of an image similar to the 
target image; and 

vector quantization means for subjecting the feature 
vector to quantization, thereby outputting, as image feature data 
of the target image, an identifier which is set on a region 
including the feature vector among plural regions partitioning a 
vector space in which plural learning vectors are defined; and 

said predictive image generation means generates image data 
of a predictive image corresponding to the target image, on the 
basis of a learning vector which is closest to a representative 
feature vector included in the region of the vector space where 
the identifier is set. 

12 . An image decoding apparatus for decoding coded image data 
which is obtained by subjecting image data of a target image to 
be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image, said apparatus comprising: 

predictive image generation means for generating image data 
of a predictive image corresponding to the target image, on the 
basis of image feature data indicating the image feature of the 
target image; and 

entropy decoding means for subjecting the coded image data 
of the target image to entropy decoding, utilizing the 
correlation in pixel values between the target image and the 
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predictive image, on the basis of the image data of the 
predictive image, thereby generating image data of the target 
image . 

13. An image coding apparatus as defined in any of Claims 1, 2, 
8, and 9 wherein: 

the image feature data is image data corresponding to a 
reduced image, which is obtained by dividing the image data of 
the target image into image data corresponding to plural blocks 
constituting the target image and each having a predetermined 
size, and replacing the image data corresponding to each block 
with a pixel value of the highest occurrence frequency among the 
pixel values of pixels in the block; and 

the predictive image generation means generates image data of 
a predictive image in which all of the pixels constituting each 
block have the highest-frequency pixel value of the target block, 
which is obtained by enlarging the respective pixels of the 
reduced image to the blocks of the predetermined size. 

14. An image decoding apparatus as defined in Claim 5 or 12 
wherein : 

the image feature data is image data corresponding to a 
reduced image which is obtained by dividing the image data of the 
target image into image data corresponding to plural blocks 
constituting the target image and each having a predetermined 
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size, and replacing the image data corresponding to each block 
with a pixel value of the highest occurrence frequency among the 
pixel values of pixels in the block; and 

the predictive image generation means generates image data of 
a predictive image in which all of the pixels constituting each 
block have the highest-frequency pixel value of the target block, 
which is obtained by enlarging the respective pixels of the 
reduced image to the blocks of the predetermined size. 

15. An image coding apparatus as defined in any of Claims 1, 2, 
8 and 9 wherein: 

the image feature data is an identifier associated with a 
vector which is selected from plural already-existing vectors 
predefined in a vector space, by using a feature vector 
indicating the feature of an image similar to the target image; 
and 

the predictive image generation means outputs, as image data 
of a predictive image for the target image, image data specified 
by the selected vector corresponding to the identifier. 

16. An image decoding apparatus as defined in Claim 5 or 12 
wherein: 

the image feature data is an identifier associated with a 
vector which is selected from plural already-existing vectors 
predefined in a vector space by using a feature vector indicating 
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the feature of an image similar to the target image; and 

the predictive image generation means outputs, as image data 
of a predictive image for the target image, image data specified 
by the selected vector corresponding to the identifier. 

17 . An image coding apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image similar to the target image, said apparatus comprising: 

entropy coding means for receiving the image data of the 
predictive image supplied from the outside, subjecting the image 
data of the target image to entropy coding, utilizing the 
correlation in pixel values between the target image and the 
predictive image, on the basis of the image data of the 
predictive image, and outputting entropy codes as coded image 
data of the target image; and 

said image coding apparatus outputting the image data of the 
predictive image as well as the entropy codes of the target image. 

18. An image coding apparatus as defined in Claim 17 further 
comprising: 

image prediction means for outputting the image data of the 
predictive image similar to the target image, to the entropy 
coding means, on the basis of the image data of the target image. 

19. An image coding apparatus as defined in Claim 18 wherein 
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said image predictive means comprises : 

feature vector extraction means for outputting a feature 
vector indicating the image feature of the image similar to the 
target image, on the basis of the image data of the target image; 

vector quantization means for subjecting the feature vector 
to quantization, thereby outputting, as image feature data of the 
target image, an identifier which is set on a region including 
the feature vector among plural regions partitioning a vector 
space in which plural learning vectors are defined; and 

predictive image generation means for generating data of a 
predictive image for the target image, on the basis of a learning 
vector which is closest to a representative feature vector 
included in the region of the vector space where the identifier 
is set. 

20. An image decoding apparatus for decoding coded image data 
which is obtained by subjecting image data of a target image to 
be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image, said apparatus comprising: 

entropy decoding means for subjecting the coded image data of 
the target image to entropy decoding, utilizing the correlation 
in pixel values between the target image and the predictive image, 
on the basis of image data of the predictive image which is input 
separately from the coded image data of the target image, thereby 
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generating image data of the target image. 

21. An image coding apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image for the target image, said apparatus comprising: 

image feature extraction means for extracting the image 
feature from the target image on the basis of the image data of 
the target image, and outputting image feature data of the target 
image; 

predictive image generation means for generating image data 
of a predictive image similar to the target image, on the basis 
of the image feature data of the target image; 

predictive image storage means for associating image data of 
a target image which has already been coded, with its image 
feature data, and storing them as image data and image feature 
data corresponding to an already-processed image; 

predictive image selection means for comparing the image 
feature data of the target image with the image feature data of 
the already-processed images which are stored in the predictive 
image storage means, and selecting, as a predictive image, either 
the similar image or a predetermined already-processed image ; 

entropy coding means for subjecting the image data of the 
target image to entropy coding utilizing the correlation in pixel 
values between the target image and the predictive image, thereby 
outputting entropy codes as coded image data of the target image; 
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and 

said predictive image selection means outputting a flag 
indicating that either the similar image or the predetermined 
already-processed image is selected as a predictive image, and 
outputting the image feature data of the target image. 

22. An image coding apparatus as defined in Claim 21 wherein: 
said image feature extraction means comprises: 

feature vector extraction means for generating a first 
feature vector as image feature data corresponding to the target 
image, on the basis of the image data of the target image; and 

character recognition means for subjecting the target 
image to character recognition on the basis of the first feature 
vector to generate a character code corresponding to the target 
image ; and 

said predictive image generation means generates, as first 
predictive image data, image data of the image similar to the 
target image, on the basis of the character code of the target 
image ; 

said predictive image storage means stores the image data of 
the target image which has already been coded, its character code, 
and its first feature vector, in association with each other; 

said predictive image selection means reads image data and a 
feature vector associated with a character code which is equal to 
the character code of the target image, as second predictive 
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image data and a second feature vector, and outputs one of the 
first and second predictive image data according to the result of 
comparison between the first and second feature vectors. 

23. An image decoding apparatus for decoding coded image data 
which is obtained by subjecting image data of a target image to 
be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image, said apparatus comprising: 

predictive image generation means for generating image data 
of an image similar to the target image, on the basis of image 
feature data indicating the image feature of the target image; 

predictive image storage means for associating image data of 
a target image which has already been decoded with its image 
feature data, and storing them as image data and image feature 
data corresponding to an already-processed image; 

predictive image selection means for selecting, as a 
predictive image, either the similar image or a predetermined 
already-processed image, on the basis of flag information 
indicating that either a similar image obtained from the image 
feature of the target image or an already-coded image is used as 
a predictive image for the target image in the coding process; 
and 

entropy decoding means for subjecting the coded image data 
of the target image to entropy decoding, on the basis of the 
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image data of the predictive image, utilizing the correlation in 
pixel values between the target image and the predictive image, 
thereby generating image data of the target image. 

24. An image decoding apparatus as defined in Claim 23 wherein: 
said predictive image generation means generates first 

predictive image data for the target image on the basis of a 
character code as image feature data of the target image; 

said predictive image storage means associates image data of 
a target image which has already been decoded, with its character 
code, and stores them as image data and a character code of an 
already-processed image; and 

said predictive image selection means reads image data 
associated with a character code which is equal to the character 
code of the target image, as second predictive image data, from 
the predictive image storage means, and outputs one of the first 
and second predictive image data on the basis of the flag 
information . 

25. An image coding apparatus for coding image data of a target 
image to be coded, on the basis of image data of a predictive 
image for the target image, said apparatus comprising: 

image feature extraction means for extracting the image 
feature of the target image on the basis of the image data of the 
target image, and outputting image feature data of the target 
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image ; 

predictive image generation means for generating image data 
of an image similar to the target image, on the basis of the 
image feature data of the target image; 

predictive image storage means for storing image feature data 
of a target image which has already been coded, as image feature 
data of an already-processed image; 

data output control means for performing either a first data 
output process or a second data output process according to the 
result of comparison between the image feature data of the target 
image and the image feature data of the already-processed image 
stored in the predictive image storage means, said first data 
output process outputting the image data of the similar image, 
the image feature data of the target image, and a coding flag 
indicating that coding should be performed, and said second data 
output process outputting the image feature data of the target 
image and a non-coding flag indicating that coding should not be 
performed; and 

entropy coding means for subjecting the image data of the 
target image to entropy coding utilizing the correlation in pixel 
values between the target image and the similar image, thereby 
outputting entropy codes as coded image data of the target image; 

wherein said entropy coding means performs entropy coding 
when it receives the coding flag, and does not perform entropy 
coding and outputs no entropy code when it receives the non- 
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coding flag. 

26. An image coding apparatus as defined in Claim 25 wherein: 
said image feature extraction means comprises: 

feature vector extraction means for generating a first 
feature vector as image feature data of the target image, on the 
basis of the image data of the target image; and 

character recognition means for subjecting the target 
image to character recognition on the basis of the first feature 
vector to generate a character code corresponding to the target 
image ; and 

said predictive image generation means generates, as 
predictive image data, image data of an image similar to the 
target image, on the basis of the character code of the target 
image ; 

said predictive image storage means stores the character 
code of a target image which has already been coded, in 
association with its first feature vector; 

said data output control means reads, as a second feature 
vector of the predictive image, a feature vector associated with 
a character code which is equal to the character code of the 
target image, and performs either a first data output process of 
outputting the image data of the similar image, the character 
code of the target image, and a coding flag indicating that 
coding is to be performed, or a second data output process of 
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outputting the character code of the target image and a non- 
coding flag indicating that coding is not to be performed. 

27. An image decoding apparatus for decoding coded image data 
which is obtained by subjecting image data of a target image to 
be coded to entropy coding utilizing the correlation in pixel 
values between the target image and a predictive image similar to 
the target image, said apparatus comprising: 

predictive image generation means for generating first 
predictive image data for the target image, on the basis of image 
feature data indicating the image feature of the target image; 

predictive image storage means for associating the image 
data of a target image which has already been decoded, with its 
image feature data, and storing them as image data and image 
feature data of an already-processed image; 

data output control means for performing, when it receives a 
coding flag indicating that coding has been performed, a first 
data output process of outputting the first predictive image data 
and the coding flag and, on the other hand, performing, when it 
receives a non-coding flag indicating that coding has not been 
performed, a second data output process of reading the image data 
of the already-processed image as second predictive image data 
from the predictive image storage means, and outputting the 
second predictive image data and the non-coding flag; and 

entropy decoding means for performing, when it receives the 
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coding flag, entropy decoding on the coded image data of the 
target image, on the basis of the first predictive image data, 
utilizing the correlation in pixel values between the target 
image and the predictive image and, on the other hand, outputting 
the second predictive image data as decoded data of the target 
image when it receives the non-coding flag. 

28. An image decoding apparatus of Claim 27 wherein: 
said predictive image generation means generates first 

predictive image data for the target image on the basis of the 
character code as image feature data of the target image; 

said predictive image storage means associates the image data 
of the target image which has already been decoded, with its 
character code, and stores them as image data and a character 
code of an already-processed image; and 

said data output control means reads, as second predictive 
image data, image data associated with a character code which is 
equal to the character code of the" target image, and outputs one 
of the first and second predictive image data on the basis of the 
flag information. 

29. An image coding apparatus as defined in any of Claims- 1, 2, 
,8, 9, 17, 18, 21, and 25 wherein: 

the entropy code is an arithmetic code obtained by 
subjecting the image data of the target image to arithmetic 



213 



coding in which the pixel value probability is changed for each 
of pixels constituting the target image; and 

the entropy coding means changes the pixel value probability, 
pixel by pixel, on the basis of the image data of the predictive 
image similar to the target image, and the image data of the 
already-coded part of the target image. 

30. An image decoding apparatus as defined in any of Claims 5, 
12, 20, 23, and 27 wherein: 

the entropy code is an arithmetic code obtained by subjecting 
the image data of the target image to arithmetic coding in which 
the pixel value probability is changed for each of pixels 
constituting the target image; and 

the entropy decoding means subjects the arithmetic code of 
the target image to arithmetic decoding in which the pixel value 
probability is changed, pixel by pixel, on the basis of the image 
data of the predictive image similar to the target image, and the 
image data of the already-decoded part of the target image, 
thereby reproduces the image data of the target image. 

31. An image coding apparatus as defined in any of Claims 1, 2, 
8, 9, 17, 18, 21, and 25 wherein: 

the entropy code is a Huffman code obtained by subjecting 
the image data of the target image to a coding process in which a 
Huffman coding table is changed for each of pixels constituting 
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the target image; and 

the entropy coding means changes the Huffman coding table, 
pixel by pixel, on the basis of the image data of the predictive 
image similar to the target image, and the image data of the 
already-coded part of the target image . 

32. An image decoding apparatus as defined in any of Claims 5, 
12, 20, 23, and 27 wherein: 

the entropy code is a Huffman code obtained by subjecting the 
image data of the target image to a coding process in which a 
Huffman coding table is charged for each of pixels constituting 
the target image; and 

the entropy decoding means subjects the coded image data of 
the target image to a decoding process in which the Huffman 
coding table is changed pixel by pixel, on the basis of the image 
data of the predictive image similar to the target image, and the 
image data corresponding to the already-decoded part of the 
target image, thereby reproduces the image data of the target 
image . 

33. An image coding apparatus as defined in any of Claims 1, 2, 
8, 9, 1,7, 18, 21, and 25 further comprising: 

attribute information addition means for receiving attribute 
information relating to the target image, and outputting the 
coded image data of the target image to which the attribute 
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information is added. 

34. (Amended) An image coding apparatus for coding image data of 
a target image to be coded, which includes a character image, 
said apparatus comprising: 

character image coding means for receiving the image data of 
the target image, and coding the image data of the character 
image included in the target image to output character image 
codes as a part of coded data of the target image; 

character image deletion means for replacing the pixel 
values of pixels constituting a part of the target image where 
the character image is placed, with the pixel values of pixels 
positioned in the vicinity of the character image, thereby 
generating image data of a non-character image where the 
character image of the target image is deleted; 

non-character image coding means for coding the image data 
of the non-character image to output non-character image codes as 
a part of the coded data of the target image; and 

said character image coding means comprising: 

a predictive image generator for generating image data 
of a predictive image similar to the character image on the basis 
of image feature data indicating the feature of the character 
image; and 

an entropy encoder for subjecting the image data of 
the target image by utilizing the correlation in pixel values 
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between the character image and the predictive image, and 
outputting entropy codes as character image codes of the 
character image . 

35. (Amended) An image decoding apparatus for receiving the 
character image codes and the non-character image codes outputted 
from the image coding apparatus defined in Claim 34, and 
reproducing the image data of the target image including the 
character image, said apparatus comprising: 

non-character image decoding means for decoding the non- 
character image codes to output the image data of the non- 
character image; 

character image decoding means for decoding the character 
image codes to output the image data of the character image; and 

image reconstruction means for compositing the character 
image and the non-character image on the basis of the image data 
of the character image and the image data of the non-character 
image, and outputting the image data of the target image 
including the character image. 

36. A character collation apparatus for collating retrieval data 
indicating a retrieval condition for retrieving a character image, 
with character image codes obtained by coding image data of a 
character image, wherein attribute information relating to a 
character image corresponding to the character image codes is 
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added to the character image codes; and 

said apparatus being provided with character attribute 
collation means for collating the retrieval data with the 
character image codes, according to whether the attribute 
information added to the character image codes satisfies the 
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retrieval condition indicated by the retrieval data. 

37. A character collation apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which image feature data indicating the image 
feature of the character image is added, which character image 
codes are obtained by coding image data of the character image, 
said apparatus comprising: 

image feature extraction means for extracting the image 
feature of the character image specified by the character code, 
and outputting it as image feature data; and 

collation decision means for collating the image feature 
data added to the character image codes, with the image feature 
data obtained from the character code, and deciding whether the 
character image codes match the character code. 

38. A character collation apparatus as defined in Claim 37 
wherein: 

the image feature data added to the character image codes is 
a feature vector indicating the image feature of the character 
image corresponding to the character image codes; 

the image feature extraction means comprises: 

character image generation means for generating image 
data of a character image specified by the character code, on the 
basis of the character code; and 
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feature vector extraction means for extracting the 
image feature of the character image on the basis of the image 
data of the character image, thereby outputting a feature vector 
indicating the image feature; and 

the collation decision means includes distance calculation 
means for calculating a distance between the feature vector added 
to the character image codes and the feature vector obtained from 
the character code, and decides whether the character image codes 
match the character code or not, according to whether the 
distance is larger than a predetermined threshold or not. 

39. A character collation apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which image data of a predictive character image 
similar to the character image is added, which character image 
codes are obtained by coding image data of the character image, 
said apparatus comprising: 

first image feature extraction means for receiving the 
character image codes, and extracting the image feature from the 
predictive character image on the basis of the image data of the 
predictive character image added to the character image codes, 
thereby outputting first image feature data; 

second image feature extraction means for receiving the 
character code, and extracting the image feature of the character 
image specified by the character code, thereby outputting second 
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image feature data; and 

collation decision means for collating the first image 
feature data with the second image feature data, and deciding 
whether the character image codes match the character code or not. 

40. A character collation apparatus as defined in Claim 39 
wherein: 

said first image feature extraction means outputs a first 
feature vector as the first image feature data; 

said second image feature extraction means comprises : 

character image generation means for generating image 
data of a character image specified by the character code, on the 
basis of the character code; and 

feature vector extraction means for extracting the 
image feature of the character image on the basis of the image 
data of the character image, thereby outputting a second feature 
vector indicating the image feature; 

said collation decision means includes distance calculation 
means for calculating the distance between the first feature 
vector and the second feature vector, and decides whether the 
character image codes match the character code or not, according 
to whether the distance is larger than a predetermined threshold 
or not. 



A character collation apparatus for collating a character 
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code specifying a character image to be retrieved, with character 
image codes to which an identifier indicating a predictive 
character image similar to the character image is added, which 
character image codes are obtained by coding image data of the 
character image, said apparatus comprising: 

table storage unit storing a character-to-character distance 
table in which the identifier of the predictive character image 
and the character code are associated with distance information 
which is calculated using the identifier and the character code 
as variables; 

distance calculation means for receiving the character image 
codes and the character code, and obtaining distance information 
having, as variables, the predictive character image identifier 
added to the character image code, and the character code, with 
reference to the character-to-character distance table; and 

collation decision means for deciding whether the character 
image codes match the character code or not, on the basis of the 
distance information. 

42. A character collation apparatus for collating a character 
code specifying a character image to be retrieved, with character 
image codes to which an identifier indicating a predictive 
character image similar to the character image is added, which 
character image codes are obtained by coding image data of the 
character image, said apparatus comprising: 
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first image feature extraction means for receiving the 
character image codes, and extracting the image feature from the 
predictive character image on the basis of the identifier 
indicating the predictive character image and added to the 
character image codes, thereby outputting first image feature 
data; 

a second image feature extraction mans for receiving the 
character code, and extracting the image feature of a character 
image specified by the character code to output second image 
feature data; and 

collation decision means for collating the first image 
feature data with the second image feature data to decide whether 
the character image code matches the character code or not. 

43. A character collation means as defined in Claim 42 wherein: 
said first image feature extraction means outputs a first 

feature vector as the first image feature data; 

said second image feature extraction means comprises: 

character image generation means for generating image 

data of a character image specified by the character code, on the 

basis of the character code; and 

feature vector extraction means for extracting the 

image feature of the character image on the basis of the image 

data of the character image to output a second feature vector 

indicating the image feature; 
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said collation decision means includes distance calculation 
means for calculating the distance between the first feature 
vector and the second feature vector, and decides whether the 
character image codes match the character code or not, according 
to whether the distance is larger than a predetermined threshold 
or not. 

44. A data storage medium containing an image processing program 
for making a computer perform image data processing, said image 
processing program being a program for making a computer perform 
image processing of an apparatus defined in any of Claims 1 to 43, 
or a program for implementing, with a computer, the function of 
at least one means which constitutes an apparatus defined in any 
of Claims 1 to 43. 

45. A facsimile comprising: 

a scanner for converting a target image to be transmitted 
into electronic data, and outputting the target image data; 

an image coding unit for coding the target image data to 
output image feature data indicating the feature of the target 
image as well as the coded data; 

a transmitter-receiver for adding the image feature data of 
the target image to the coded data of the target image, and 
transmitting/receiving composite data including the coded data 
and the image feature data through a communication line; 
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an image decoding unit for receiving the coded data and the 
image feature data included in the composite data received by the 
transmitter-receiver, and decoding the coded data on the basis of 
the image feature data to output target image data; and 

an image output unit for displaying or printing out the 
target image on the basis of the target image data; 

wherein the image coding unit is identical in structure to an 
image coding apparatus as defined in any of Claims 2, 8, 9, 14, 
17, 18, and 33. 

46. A facsimile comprising: 

a scanner for converting a target image to be transmitted 
into electronic data, and outputting the target image data; 

an image coding unit for coding the target image data to 
output image feature data indicating the feature of the target 
image as well as the coded data; 

a transmitter-receiver for adding the image feature data 
relating to the coded data to the coded data, and transmitting 
and receiving composite data including the coded data and the 
image feature data through a communication line; 

an image decoding unit for receiving the coded data and the 
image feature data included in the composite data received by the 
transmitter-receiver, and decoding the coded data on the basis of 
the image feature data to output target image data; and 

an image output unit for displaying or printing out the 
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target image on the basis of the target image data; 

wherein the image decoding unit is identical in structure to 
an image decoding apparatus as defined in any of Claims 5, 12, 16, 
and 20. 

47. A filing apparatus comprising: 

a scanner for converting a target image to be filed into 
electronic data, and outputting the target image data; 

an image coding unit for coding the target image data, and 
outputting image feature data indicating the feature of the 
target image as well as the coded data of the target image; 

an image storage means for storing the coded data in 
association with the corresponding image feature data; 

a data reading means for reading coded data of a 
predetermined image and the corresponding image feature data from 
the image storage means, on the basis of a character code 
supplied from the outside as retrieval data; 

an image decoding means for decoding the read coded data by 
using the image feature data to restore the image data of the 
predetermined image; and 

an image output unit for displaying or printing out the 
predetermined image, on the basis of the image data; 

wherein said image coding unit is identical in structure to 
an image coding apparatus as defined in any of Claims 2, 8, 9, 14, 
17, 18, and 33'. 
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48. A filing apparatus comprising: 

a scanner for converting a target image to be filed into 
electronic data, and outputting the target image data; 

an image coding unit for coding the target image data, and 
outputting image feature data indicating the feature of the 
target image as well as the coded data of the target image; 

an image storage means for storing the coded data in 
association with the corresponding image feature data; 

a data reading means for reading coded data of a 
predetermined image and the corresponding image feature data from 
the image storage means, on the basis of a character code 
supplied from the outside as retrieval data; 

an image decoding means for decoding the read coded data by 
using the image feature data to restore the image data of the 
predetermined image; and 

an image output unit for displaying or printing out the 
predetermined image, on the basis of the image data; 

wherein said image decoding means is identical in structure 
to an image decoding apparatus as defined in any of Claims 5, 12, 
16, and 20. 

49. A filing apparatus comprising: 

a scanner for converting a target image to be filed into 
electronic data, and outputting the target image data; 
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an image coding unit for coding the target image data, and 
outputting image feature data indicating the feature of the 
target image as well as the coded data of the target image; 

a document image storage means for storing the coded data in 
association with the corresponding image feature data; 

a data reading means for reading coded data of a 
predetermined image and the corresponding image feature data from 
the image storage means, on the basis of a character code 
supplied from the outside as retrieval data; 

an image decoding means for decoding the read coded data by 
using the image feature data to restore the image data of the 
predetermined image; and 

an image output unit for displaying or printing out the 
predetermined image, on the basis of the image data; 

wherein said data reading means includes a character 
collation apparatus as defined in any of Claims 36 to 43. 
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ABSTRACT 



An image coding apparatus according to the present invention 
is provided with, as shown in figure 2, an image feature 
extraction means 202 for generating character data Dc which 
includes character codes corresponding to character images 
included in a document image 201 and an auxiliary information 
indicating the sizes and positions of the respective character 
images in the document image, on the basis of image data Di 
indicating the document image. The image coding apparatus 
generates a predictive document image 205 for the document image 
201 on the basis of the character data Dc and, further, subjects 
the document image data Di to arithmetic coding in which the 
probability model is changed with reference to the predictive 
document image data PDi . 

In the image coding apparatus 202 so constructed, the 
probabilities of white pixels and black pixels indicated by the 
probability model are very close to those in the character image, 
whereby the coding efficiency for the character image data in the 
arithmetic encoder is improved. 
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(57) Abstract 

An image encoder has image feature extracting means (202) for generating, as shown in the Figure, text data Dc including character 
codes corresponding to respective text images contained in a document image (201) and auxiliary information on the sizes and positions of 
the text images based on image data Di on the document image (201). Based on the text data Dc, a predicted document image (205) of the 
document image (201) is formed, and an arithmetic encoding for changing an event probability model of the document image data Di is 
performed with reference to the predicted document image data PDi. Thus, the event probabilities of white and black pixels represented by 
an event probability model are nearly equal to the respective probabilities of white and black pixels in a text image, and the efficiency of the 
encoding of the text image data by an arithmetic encoder is improved. 
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